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The concept of applicable continua for 
quantitatively describing the varying verbali- 
zations of the psychotherapist has previously 
been presented [3]. The purpose of this article 
is to describe some initial attempts to quanti- 
fy one of these continua, and to outline some 
of the applications that seem to be feasible 
from this approach. In the article referred to 
above two continua were selected for special 
attention from among those suggested. These 
were (a) the uncovering or interpretive con- 
tinuum and (4) the responsibility-balance con- 
tinuum. In the present paper attention will 
be given only to the first of these. 

With reference to the interpretive continu- 
um, it is noted that, among other things, the 
therapist’s verbalization is designed to aid the 
client in arriving at a clearer awareness than 
has existed before of some feeling, 2ttitude, 
relationship, or aspect of his personality. Op- 
portunities for changes in meaning are assumed 
to be facilitated. Examination of verbatim 
transcriptions of psychotherapy interviews re- 
veals variation, not only among therapists, but 
for the same therapist from one response to 
another, in the degree to which a therapist’s 
responses seem designed to facilitate an in- 
creased awareness of a relatively unrecognized 
aspect of a client’s tendencies. It is neither de- 
nied nor forgotten that therapists do other 
things as well. They “structure relationships” ; 
they indicate an “accepting,” “permissive,” 
“understanding” approach; at times, some may 
include “reassurance,” “advice,” and “suppor- 
tive” therapy; they may also ask questions. 
Obviously, no particular school of therapy is 
here being emphasized. It is not the purpose 

1This article was completed after the writer ac- 


cepted a position as Chief Psychologist at the Jef- 
ferson Barracks Veterans Administration Hospital. 
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of this series of studies to carry the aegis for 
any system to the exclusion of others. The 
initial problem of this study was to devise 
classificatory descriptions of a larger number 
of steps along the uncovering-interpretive con- 
tinuum than was done in the former article. 
In this earlier publication five steps were in- 
dicated. It remained to determine (a) if ad- 
ditional steps could be described, () if judges 
with experience in psychotherapy could reliably 
distinguish differences among these positions 
or along such a scale, and (c) to what extent 
would the original assumptions about relative 
scale positions be borne out by ratings of ex- 
perienced judges. 

The descriptive items that appear below to- 
gether with the accompanying instructions 
were submitted to 40 psychotherapists—ana- 
lytic psychiatrists and clinical psychologists. 
‘Twenty-six returned the material with com- 
pleted ratings. Several of the remaining 14 ex- 
plained that the approach seemed too different 
from their theoretical orientation to provide 
a basis for making the requested judgments. 
One thought this to be an attempt to stereo- 
type therapy and declined on that basis; an- 
other misunderstood the directions, assuming 
that the experimenter wished him to score him- 
self in retrospect as he had performed therapy. 
The wide variety of approaches to the thera- 
peutic relationship was inescapably evident 
from the letters of those who declined to par- 
ticipate. The variety of theoretical back- 
grounds for psychotherapy increases the diffi- 
culty of adequate communication. This prob- 
lem is illustrated by the critic who felt that 
the writer was attempting to stereotype psy- 
chotherapy, whereas one of the main interests 
behind this series of studies is to test the possi- 
bility of liberating psychotherapy from a stereo- 
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typed procedure. 

The rating sheet was entitled “A Study in 
Discrimination” and the task was introduced 
by the following instructions: 


You are being asked in this study to judge or 
rate types or kinds of responses which psychother- 
apists make in helping a patient work through his 
problems. It may be assumed for purposes of this 
study that therapists’ responses are designed, among 
other things, to aid the patient in developing in- 
sights, penetrating resistances, or uncovering hith- 
erto unrecognized aspects of the personality. The de- 
gree to which the therapist response is designed to 
penetrate typical resistances or uncover, etc. may 
vary from little or nothing to very much. Further- 
more, it must be emphasized that no implications 
are indicated in regard to what are appropriate or 
desirable therapist responses. Such judgments are 
made in terms of other criteria. Since this is a dif- 
ferent type of evaluation or judgment, your dis- 
criminations in terms of the present variable are to 
be made independently of theoretical convictions 
you may have about what a therapist should do. 

Below are descriptions of these types of responses. 
Ratings must, of course, be in terms of general im- 
plications, since it is recognized that the context of 
a specific therapy situation would introduce some 
variation. After reading a description of a type of 
therapy technique, indicate by encircling a numeri- 
cal position on the scale (1 to 11) the degree to 
which that kind of response seems in general de- 
signed to penetrate typical resistances, uncover or 
bring into clearer recognition an aspect of person- 
ality. Read all descriptions before rating any of 
them. Remember 1 — low degree of the variable 
described; 11 = high degree. 


The descriptive items are presented below. 
Except for item a, the scale which appeared 
after each item has been omitted. 


a. The therapist repeats the statement the patient 
has just made. 


Pe ee ee ee ee a ee Oe oe 


b. The therapist suggests a relationship between 
what the patient has just said and what he said at 
an earlier time. 


c. The therapist responds by a nonverbal vocali- 
zation, e.g., ““M-hm.” 


d. The therapist abstracts common dynamic ele- 
ments or trends from repetitive occurrences of pat- 
terns of feelings, thoughts, and action when such 
patterns are dominated by a dissociated, rejected, 
or repressed experience or trend and brings this re- 
lationship to the recognition of the patient by any 
of a variety of interpretive procedures. 


e. The therapist selects a portion of the patient’s 
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response and repeats it. 
f. The therapist remains silent. 


g. The therapist condenses or epitomizes what the 
patient has just said in terms of what seems to be 
the essential immediate meaning of the patient’s 
response. 


h. The therapist suggests a relationship between 
current attitudes and reactions of patient and early 
experiences or tendencies when such relationships 
have thus far gone unrecognized or only symboli- 
cally represented. 

i. The therapist suggests a relationship between 
a current patient response and some early experience 
or tendency when such relationship has already 
been vaguely recognized by the patient. 

j. The therapist phrases his response so as to in- 
dicate a recognition of the feeling or emotional 
aspect of what the patient has just said. 

k. The therapist phrases his response so as to in- 
dicate a recognition of the content of what the pa- 
tient has just said. 


Results and Interpretation 


The data collected in the manner described 
above were treated according to Thurstone’s 
method (10) for attitude-scale building. Per- 
centile points were determined graphically. 
Table 1 shows the results, based on an N of 
26. The entries of the table are arranged in 
descending order of the Qz. values. 


Table 1 


Initial Scale Values of the Uncovering Continuum 








Descriptive Quartile Points 





Items 0, 0, Q; 0,—0, 
d 9.4 10.3 10.6 1.2 
h 7.8 9.1 9.7 1.9 
i 7.4 8.2 9.0 1.6 
b 4.8 6.5 7.6 2.8 
j 4.5 5.5 6.5 2.0 
g 3.4 5.4 6.6 3.2 
e 2.0 3.5 4.7 2.7 
bk 1.8 2.7 3.7 1.9 
a 0.6 1.5 2.8 2.2 
c 0.6 1.4 2.1 1.5 
f 0.3 0.7 2.4 2.1 





From Table 1 it is apparent that these de- 
scriptive categories of therapists’ responses rep- 
resent discriminable differences. The scale dis- 
tances from one item to the next, however, 
are not uniform, nor was it expected that they 
would be. It is theoretically possible, however, 
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to construct sufficient additional descriptive 
categories so that a later more ambitious scaling 
attempt could provide a residuum of items 
which would represent a more uniform se- 
quence of steps from one scale extreme to the 
other. Items used here tend to represent about 
five regions or levels according to their tenden- 
cy to cluster. Since the average semi-inter- 
quartile range is 1.05, it is assumed somewhat 
arbitrarily that scale distances greater than 1 
between items begin to represent reliable differ- 
ences. Thus, near the zero end there are three 
items within a range of 1.1; these are f, c, and 
a. Silence, m-hm, and repetition appear at 
scale positions of 0.7, 1.4, and 1.5, respectively. 
It may be a mistake to put silence in this group 
for theoretical reasons and it does seem to be 
somewhat by itself. Clearly, however, m-hm 
and repetition are scaled in very close prox- 
imity. The second level is represented by & 
and e, wherein simple recognition of content 
and repetition of a selected portion of the pa- 
tient’s response seem more similar to each other 
than to items on either side. 


In the midpart of the scale three items occur 
within the range of 1.1, while the cluster is 
separated on either side by nearly 2 scale 
points. These items, g, j, and 5, are categories 
of therapists’ responses which seem obviously 
designed to provide more aid in the reassoci- 
ative process than those preceding. That the 
scaled apparent intent of the therapist corre- 
sponds with the implied result, i.e., that the 
reassociative process is facilitated, is a hypothe- 
sis which remains to be tested. However, it 
would seem more penetrating or revealing, 
for example, to recognize feeling (7 = 5.5) 
than simply to recognize content (4 = 2.7); 
or, to suggest a relationship between current 
and previous patient verbalization (4 = 6.5) 
would seem more revealing than simply to 
repeat a portion of a patient’s response (e = 
3.5). 

The writer recognizes, of course, that 
specific therapy situations under which these 
categories of responses occur can cause con- 
siderable variation in a therapist’s intent and 
in the associative facilitation for the patient. 
Because of this, one may be somewhat surprised 
that the Q measure of reliability does not in- 
dicate more variability than it does. 
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The fourth level is represented by i and h at 
8.2 and 9.1, respectively. Both of these items 
describe therapists’ responses as suggesting re- 
lationships. This also occurred for 6 at 6.5; 
but at 8.2 and 9.1 the relationship dealt with 
has gone beyond two temporally separated pa- 
tient responses and involves relationships either 
only vaguely recognized or symbolically repre- 
sented by the patient. Again, it would seem 
obvious that the therapist is using a more 
penetrating technique than at levels scaled at 
lower values. 

The fifth level is represented in this study 
by d, scaled at 10.3. Here the therapist is 
again suggesting relationships, but now it is 
on a broader basis. He attempts to help his 
patient see common dynamic elements running 
through a variety of experiences and activities 
when these elements have tended to elude the 
patient because of dissociative emotional re- 
sistances. Perhaps it should be said again that 
the purpose of this paper is concerned neither 
with the “whether” nor the “when” problems 
of appropriateness of these categories of thera- 
pist activity. Some therapists would be ap- 
palled by the idea of their ever using a response 
scaled higher than the one at 5.5. Others do 
not hesitate to use a variety of responses rang- 
ing over the whole scale. Only extensive evalu- 
ative studies can eventually provide the an- 
swers of “if” and “when” these categories are 
appropriate. 

Pilot-study applications of this scale have 
been made to such material as found in Sny- 
der’s Casebook [9], Axline, Play Therapy 
[1], Rogers’ case of Herbert Bryan in Coun- 
seling and Psychotherapy [7], Berg’s Deep 
Analysis [2], Deutsch’s Applied Psychoanalysis 
[4], and Eidelberg’s Take Off Your Mask 
[5]. In the Axline material the writer has 
found nothing to rate beyond a scale value of 
four; in Snyder and Rogers the upper scale 
value limit is six. The therapist responses in 
Berg, Eidelberg, and Deutsch seem to range 
over the whole scale. On well-known theo- 
retical grounds, the “nondirective” group im- 
poses limitations on themselves which the 
analysts do not. In terms of therapy goals, 
e.g., quality and rates of improvement, it re- 
mains to be determined what limits are ap- 
propriate for age, sex, type of problem, stage 
of therapy, etc. 
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In general, the hypothesis presented in the 
earlier publication [3] that there were dis- 
criminable differences along an uncovering or 
revelatory interpretive continuum has had in- 
itial confirmation. Furthermore, the steps along 
the scale as described at that time have oc- 
cupied the sequence anticipated. However, the 
progressive increase in scale distance through 
the originally described five steps has not been 
confirmed in this study. In part this may be 
due to the accidents of illustrative selections, 
but it is apparently more assignable to larger 
discernible differences among the categories of 
responses at the lower end of the continuum 
than were hypothetically anticipated. Thus, 
there may be, for example, a greater scalable 
difference between repeating the client’s state- 
ment and repeating a selected portion of the 
client’s response than was originally assumed. 
Certainly one finds an analyst like Deutsch 
[4] using the technique of repeating a selected 
portion of a patient’s response in a very pene- 
trating manner. 


In a second part of this study, 50 examples 
of verbal exchanges were submitted for rating 
to staff members and advanced graduate stu- 
dents who had had experience and training in 
psychotherapy. An eleven-point scale and simi- 
lar instructions were used. Included in these 
selections were the examples in the initial 
article [3]. These selections were included in 
order to test the following hypotheses: (a) 
that these examples represent a sequence of dis- 
criminable differences along this continuum, 
() that the scale differences become progress- 
ively greater from one example to the next. 
The examples were as follows: 


a. Pt. I hate my father, I hate my brother! 


Th. You hate your father, you hate your broth- 
er. 


b. Pt. I'll be ten years old. I’m in the fourth 
grade. My dad wants me to be in the fifth grade, 
but I tell him I don’t want to be in the fifth grade. 
I like to fail. 


Th. You like to fail. 


¢. Pt. The only thing is that I can’t help but feel 
that I work against myself. I mean it’s just so 
obvious to me that I do work against myself. And 
it seems rather silly to be one minute trying to do 
something about it, and then it seems so certain that 
there’s something present that doesn’t want to do 
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anything about it. (Pause) It’s such a contrary thing 
—the whole problem is just— 

Th. So that the very time that one part of you 
is perhaps really taking hold of this whole situa- 
tion, another part of you is just sabotaging the 
whole business. 


d. Th. Do you remember that you had the same 
feeling in connection with mother, for whose health 
you were concerned, and that you behaved as if you 
were she? Do you remember that I reminded you 
of a statement of little Ralph who once said, “If I 
don’t stop behaving so badly, it will kill her.” Do 
you remember you said it? 

Pt. That’s right. 


Th. And that you had to run home to see 
whether she were still alive and that you had a 
bad conscience as if you had done something 
wrong? Then you said something wrong means: 
Something is wrong with your heart or you did 
something wrong. Now, you said when your girl 
friend complained about her heart, you felt as if 
you were she. 


e. Pt. He started to undress me and I embraced 
him. Suddenly, the image of my aunt appeared, and 
again I heard her warning. I grew frightened and 
ran away from Carl. 


Th. What happened to the sexual excitement? 


Pt. It disappeared as soon as I remembered my 
aunt’s warning and grew frightened. 

Th. Without this anxiety, you probably would 
not have heeded your aunt’s warning, and you 
probably would have had sexual intercourse with 
Carl. From this point of view, the anxiety was a 
valuable help, because your sexual desire had de- 
stroyed your ability to resist your cousin. If your 
aunt’s warning had appeared without anxiety, you 
would not have had the power to interrupt your 
sexual play and to escape unharmed. That was the 
situation at the time. Today, however, sexual inter- 
course is no longer a danger. Now you may con- 
ceive a child without being blamed for it. But you 
still behave as if you were a little girl. Why? 


The scale values of these examples are given 
in Table 2, based on an N of 24. 


Table 2 


Scaled Examples of Psychotherapists’ Responses 











Examples Quartile Points 
0, 0, Q; 
a 0.7 1.6 2.5 
b 14 1.9 3.6 
c 4.0 5.3 6.7 
d 8.0 8.7 9.6 
e 8.5 9.2 9.7 
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These data confirm the first hypothesis 
which stated that these verbal exchanges would 
represent discriminable differences along the 
continuum as described. The results with 
specific examples are similar to the results ob- 
tained when types of exchanges are rated. The 
finding implies that this kind of judgment can 
be made with a measurabie degree of reliability, 
and that judges tend to perceive these differ- 
ences in a similar way. The second hypothesis, 
which stated that there would tend to be 
progressive increases in scale distance from 
one example to the next, is only partly con- 
firmed. The sequence of scale differences is as 
follows: b-— a= 0.3; c-b=3.2;d-—c=3.4; 
and e — d= 0.5. The first three differences 
become progressively larger, but the suggested 
pattern breaks down at e — d. These differ- 
ences are, of course, in part, a function both 
of the method used and the examples selected. 
A paired-comparison method would yield some- 
what different results. A longer scale might 
also make a difference, since some judges tend 
to be conservative in their use of extreme 
ends of a rating scale. Both the b—a and the e—d 
distances suggest this well known tendency of 
conservative raters to regress their ratings away 
from the extremes. That the selection of ex- 
amples is important, also, is indicated by the 
fact that some in this set of 50 were consist- 
ently rated higher than the one used to illus- 
trate the upper extreme in 1950. Such an 
example follows: 


Pt. My other dream seems to make no sense at all. 
I wanted my boy friend to kiss me and yet I felt 
I shouldn’t hesitate to kiss him if I want to. Then 
as I started to kiss him, my nose got in the way; it 
seemed longer than usual, sort of like it had Pinoc- 
chio- qualities. Jack noticed it right away. He 
seemed disappointed. 

Th. How did you feel? 


Pt. I believe I felt both surprise and somewhat 
elated. 


Th. Elated even though your boy friend was 
disappointed. 

Pt. That’s what doesn’t make sense. I don’t want 
to lose him, but I seem to remember feeling that 
now I’m as good as he is. 

Th. Do you remember telling me that your father 
probably would have been happier it you had been 
a boy and that as you grew up you often competed 
with boys in boys’ games? Now, it seems you would 
still like to compete; this time it’s with your boy 


friend in playing the masculine role. You would 
not only like to be the aggressor but would also like 
to have a masculine genital organ. 


The Q. value of this example is 10.2 with 
QO; and Q, at 10.6 and 9.1 respectively. The 
interquartile difference of 1.5 indicates little 
disagreement in the scale location of this item. 


Applications of the Scale 
Among the anticipated applications of a scale 
of this kind the following few are suggested: 


1. Assuming that reliable criteria of patient 
improvement can be identified, we may relate 
the indices of improvement to scale levels used 
by the therapist. 

2. Rogers and some of his students have 
insisted that insight occurs most frequently fol- 
lowing simple acceptance by the therapist of 
what the client has said. Assuming that in- 
sightful responses may be identified and rated, 
we can relate the frequency of insight of vary- 
ing degrees of comprehension to the scale level 
represented by the therapist’s responses. Ac- 
cording to Rogers’ approach, we should expect 
the higher scale values of therapists’ responses 
to be followed (a) by a reduced frequency of 
insight and (4) by an increased frequency of 
rejection by the client of these thetapist re- 
sponses. The writer’s experience is such as to 
cast strong doubt on these theoretical posi- 
tions. 

3. Assuming that dependency and transfer- 
ence tendencies can be reliably identified in 
transcripts, we can relate these tendencies to 
scale value levels represented by the therapist. 
The nondirective school [8] would perhaps 
hypothesize that the more frequently the upper 
levels of the scale were used the greater would 
be the tendency for a dependency relationship 
on the therapist to develop. 

4. Should therapy with psychotics and pre- 
psychotics be supportive and noninterpretive? 
The literature on psychotherapy is in serious 
disagreement on the answer to this question. 
In the light of a scale approach such as the 
one above, the question might be revised as 
follows: “How interpretive should the thera- 
pist be in order to effect maximum improve- 
ment in the psychotic or prepsychotic patient ?” 
Factors of age, sex, type of diagnosis, and 
duration of disturbance would have to be con- 
trolled in such an approach. 
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5. Fiedler’s result [6] that experienced 
therapists are more alike regardless of school 
than are therapist and student within a school 
could be re-examined by this scaling approach. 
The writer’s anticipation is that results from 
applying the interpretive continuum would not 
agree with Fiedler. 

6. There are also applications in the train- 
ing of students. One of these, certainly, is chat 
this approach provides an integrative rationale 
which enables the student to feel secure with 
a more uncovering or interpretive approach to 
his patient under certain circumstances than 
if he is “all” analytic or “all” nondirective. 
Another application lies in the direction of 
testing the sensitivity of the student. Stu- 
dents’ ratings of therapists’ responses in ex- 
amples of patient-therapist verbal interchanges 
seem to reveal varying degrees of student sensi- 
tivity to the implications of the interchange. 
Such ratings related to relative success in 
clinical courses, e.g., psychotherapy, might 
yield useful predictive results. 


Summary 


The continuum concept previously devel- 
oped for quantitative application to the re- 
sponses of the psychotherapist has been ex- 
tended and initially applied. Types of therapist 
responses have been identified and scaled ac- 
cording to the Thurstone method of attitude- 
scale building. Reliability scores of scale posi- 
tions indicate that judges with experience in 
psychotherapy tend to perceive the descriptive- 
scale items with a fair degree of consistency. 
The continuum concept developed previously 
for psychotherapy material has had initial sub- 
stantiation. The hypothetical scale positions in- 
dicated in the previous article have been initial- 
ly verified with minor exceptions. A variety of 
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applications of this type of scale have been sug- 
gested for testing hypotheses concerning (a) 
relationships between patient improvement and 
quantitative variations of therapist activity, 
(4) relationships between type and frequency 
of insight and scale positions representing 
therapist responses, (c) relationships between 
content indications of transference and scale 
ratings of therapist responses, (d) relation- 
ships between scale ratings of therapists’ re- 
sponses and effective work with psychotics. 

These are a few examples suggested only to 
illustrate what seem to be potentially fruitful 
applications of this continuum approach to 
some of our problems in psychotherapy. 


Received January 5, 1953. 
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An Ego-Strength Scale Which Predicts Response 
to Psychotherapy 


Frank Barron 


Institute of Personality Assessment and Research 
University of California 


This paper reports the development and 
cross-validation of a scale which was originally 
designed to predict the response of psycho- 
neurotic patients to psychotherapy. Considera- 
tion of the scale content and its correlates, 
however, suggests that a somewhat broader 
psychological interpretation be placed upon it, 
making it useful as an assessment device in any 
situation where some estimate of adaptability 
and personal resourcefulness is wanted. It ap- 
pears to measure the various aspects of effective 
personal functioning which are usually sub- 
sumed under the term “ego-strength.” 


The scale consists of 68 items from the Min- 
nesota Multiphasic Personality Inventory, se- 
lected from a total MMPI pool of 550 items 
on the basis of significant correlation with 
rated improvement in 33 psychoneurotic pa- 
tients who had been treated for six months in 
a psychiatric clinic. The test responses of the 
patients were obtained before psychotherapy 
began, so that the scale, so far as logic of con- 
struction is concerned, is designed to predict 
whether or not after about six months of 
therapy the patient will have improved. 


The sample of 33 patients was divided into 
two groups: 17 patients who were judged to 
have clearly improved, and 16 patients who 
were judged to be unimproved. Although the 
sample is small, the cases were intensively stud- 
ied, and two skilled judges who had thor- 
oughly acquainted themselves with the course 
of the therapy (although not themselves in- 


1This study was carried out for the most part at 
the Institute of Personality Assessment and Re- 
search, and was supported financially by a grant of 
the Rockefeller Foundation to that institute. Drs. 
Robert E. Harris and Timothy Leary supplied data 
for two of the cross-validating samples. 
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volved in it otherwise) were in considerable 
agreement (r of .91) in their independent rat- 
ings of degree of improvement. While one 
would not ordinarily base scale development 
on a sample of this size, it was reasoned here 
that a small number of well-studied cases who 
were classified with high reliability, and, as 
collateral evidence indicated [2], with high 
accuracy as well, would serve better than the 
practical alternative, which was to get a large 
sample in which the therapist’s rating of out- 
come was accepted uncritically. 

When the Improved and Unimproved 
groups were scored on this 68-item scale, the 
mean of the Improved group proved to be 
52.7, that of the Unimproved group 29.1, a 
difference which is significant well beyond the 
01 level (¢ of 10.3). The odd-even reliability 
of the scale in a clinic population of 126 pa- 
tients is .76. Test-retest reliability after three 
months in a sample of 30 cases is .72. 

The 68 items of the scale are presented be- 
low, arranged in gréups according to the kinds 
of psychological homogeneities which, in the 
judgment of the writer, are involved in the 
item content.” 


1. Physical functioning and physiological stahil- 
ity. 153. During the past few years I have been 
well most of the time (T). 51. I am in just as 
good physical health as most of my friends (T). 


2 The improved direction of response is given in 
parentheses after each item. The item numbering is 
taken from the booklet form of the MMPI. To save 
printing costs, a table giving the percentages of 
improved and unimproved patients answering each 
item “true” has been deposited with the American 
Documentation Institute. Order Document No. 4045 
from ADI Auxiliary Publications, Photoduplication 
Service, c/o Library of Congress, Washington 25, 
D.C., remitting in advance $1.25 for 35-mm. mi- 
crofilm or $1.25 for 6 by 8-in. photocopies. 
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174. I have never had a fainting spell (T). 189. I 
feel weak all over much of the time (F). 187. My 
hands have not become clumsy or awkward (T). 
34. I have a cough most of the time (F). 2. I have 
a good appetite (T). 14. I have diarrhea once a 
month or more (F). 341. At times I hear so well 
it bothers me (F). 36. I seldom worry about my 
health (T). 


2. Psychasthenia and seclusiveness. 384. I feel 
unable to tell anyone all about myself (F). 489. I 
feel sympathetic towards people who tend to hang 
on to their griefs and troubles (F). 236. I brood a 
great deal (F). 217. I frequently find myself wor- 
rying about something (F). 100. I have met prob- 
lems so full of possibilities that I have been unable 
to make up my mind about them (F). 234. I get 
mad easily and then get over it soon (T). 270. 
When I leave home, I do not worry about whether 
the door is locked and the windows closed (T). 
359. Sometimes some unimportant thought will run 
through my mind and bother me for days (F). 
344. Often I cross the street in order not to meet 
someone I see (F). 241. I dream frequently about 
things that are best kept to myself (F). 

3. Attitudes towards religion. 95. I go to church 
almost every week (T). 488. I pray several times 
every week (F). 483. Christ performed miracles 
such as changing water into wine. (F). 58. Every- 
thing is turning out just like the prophets of the 
Bibie said it would (F). 420. I have had some 
very unusual religious experiences (F). 209. I be- 
lieve my sins are unpardonable (F). 

4. Moral posture. 410. I would certainly enjoy 
beating a crook at his own game (T). 181. When 

get bored, I like to stir up some excitement (T). 
94. I do many things which I regret afterwards (I 
regret things more or more often than others seem 
to) (F). 253. I can be friendly with people who do 
things which I consider wrong (T). 109. Some 
people are so bossy that I feel like doing the oppo- 
site of what they request, even though I know they 
are right (T). 208. I like to flirt (T). 430. I am 
attracted by members of the opposite sex (T). 
548. I never attend a sexy show if I can avoid it 
(F). 231. I like to talk about sex (T). 378. I do 
not like to see women smoke (F). 355. Sometimes 
I enjoy hurting persons I love (T). 


5. Sense of reality. 33. I have had very peculiar 
and strange experiences (I). 349. I have strange 
and peculiar thoughts (F). 251. I have had blank 
spells in which my activities were interrupted and 
I did not know what was going on around me (F). 
48. When I am with people, I am bothered by hear- 
ing very queer things (F). 22. At times I have fits 
of laughing and crying that I cannot control (F). 
192. I have had no difficulty in keeping my balance 
in walking (T). 62. Parts of my body often have 
feelings like burning, tingling, crawling, or like 
“going to sleep”. 541. My skin seems to be un- 
usually sensitive to touch (F). 
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6. Personal adequacy, ability to cope. My plans 
have frequently seemed so full of difficulties that 
I have had to give them up (F). 82. I am easily 
downed in an argument (F). 32. I find it hard to 
keep my mind on a task or job (F). 244. My way 
of doing things is apt to be misunderstood by others 
(F). 555. I sometimes feel that I am about to go to 
pieces (F). 544. I feel tired a good deal of the 
time (F). 261. If I were an artist, I would like to 
draw flowers (F). 554. If I were an artist, I 
would like to draw children (F). 132. I like col- 
lecting flowers or growing house plants (F). 140. I 
like to cook (F). 380. When someone says silly or 
ignorant things about something I know, I try to 
set him right (T). 

7. Phobias, infantile anxieties. 367. I am not a- 
fraid of fire (T). 525. I am made nervous by cer- 
tain animals (F). 510. Dirt frightens or disgusts 
me (F). 494. I am afraid of finding myself in a 
closet or small closed place (F). 559. I have often 
been frightened in the middle of the night (F). 

8. Miscellaneous. 221. I like science (T). 513. I 
think Lincoln was greater than Washington (T). 
561. I very much like horseback riding (F). 458. 
The man who had most to do with me when I was 
a child (such as my father, stepfather, etc.) was 
very strict with me (T). 421. One or more mem- 
bers of my family is very nervous (T). 


The pretherapy characteristics of patients 
who improve in therapy, as compared with 
those who do not improve, might be summar- 
ized as follows: 


Improved: (a) good physical functioning; 
(+) spontaneity, ability to share emotional ex- 
periences; (c) conventional church member- 
ship, but nonfundamentalist and undogmatic 
in religious beliefs; (d) permissive morality; 
(e) good contact with reality; (f) feelings of 
personal adequacy and vitality; (g) physical 
courage and lack of fear. 

Unimproved: (a) many and chronic physi- 
cal ailments; (4) broodiness, inhibition, a 
strong need for emotional seclusion, worri- 
someness ; (c) intense religious experiences, be- 
lief in prayer, miracles, the Bible; (d) repres- 
sive and punitive morality; (e) dissociation 
and ego-alienation; (f) confusion, submissive- 
ness, chronic fatigue; (g) phobias and infantile 
anxieties. 

From an inspection of these differences, one 
might easily be led to envy the mental salubrity 
of psychoneurotic patients who are about to 
improve. Their actual mental distress, how- 
ever, has been detailed in case material pre- 
sented in two previous reports [2, 3], and 
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will not be repeated here. What the group 
comparison really reveals, of course, is the 
dimension on which the improved and un- 
improved groups differed. Had the improved 
patients been compared with an exceptionally 
healthy nonclinic group of subjects, the same 
items might well have emerged as descriptive 
of the difference between the groups, but with 
the characteristic responses of the improved pa- 
tients being exactly opposite to those listed 
above. In other words, the nature of the cri- 
terion behavior determines the nature of the 
dimension which the item analysis will reveal, 
but the question of the strength of that vari- 
able in the criterion groups must be answered 
separately. 

In this case, it is suggested that what is be- 
ing measured is a general factor of capacity 
for personality integration, or ego-strength. 
The greater vividness of psychopathology often 
tends to obscure the ego-synthetic or construc- 
tive forces in the behavior of a psychologically 
disturbed individual, so that a prognostic 
evalution is generally more difficult to make 
than a diagnostic evaluation. Nevertheless, in 
spite of the saliency of psychopathology in the 
clinical picture, it may be presumed that the 
patient has certain latent strengths which will 
gradually show themselves, particularly as the 
psychological crisis which brings him to ther- 
apy subsides. What the item content of the 
prediction scale seems to indicate is that these 
strengths are of the sort that are generally 
ascribed to a well-functioning ego, and that it 
is latent ego-strength which is the most im- 
portant determinant (within the patient) of 
response to brief psychotherapy. 

Such an interpretation would, of course, 
have relatively little warrant without support- 
ing evidence from other samples. The obvious 
next step is to inquire into the relation of the 
scale to other measures in new populations. 


Correlates of the Prediction Scale 


In this further inquiry, one clinic sample 
and two nonclinic samples were studied. The 
clinic sample consisted of 77 women and 50 
men who were seen for diagnostic studies on 
the Psychology Service at Langley Porter 
Clinic during a given term of work. The non- 
clinic samples consisted of 160 male Air Force 
officers and 40 male graduate students. 


The first step was to obtain adjective de- 
scriptions, by objective and skilled observers, 
of high and low scorers on the prediction scale. 
This was made possible by administering the 
MMPI to graduate students who were partic- 
ipating in intensive three-day psychological 
assessments being conducted at the Institute of 
Personality Assessment and Research, Univer- 
sity of California, Berkeley. Following the 
assessment periods, the staff members of the 
Institute filled out: an adjective checklist with 
the purpose of describing each one of the sub- 
jects in the assessment, on the basis of the 
subject’s socially observable behavior in situa- 
tional procedures, interviews, and informal 
social interaction. A composite staff impression 
was thus assembled. The 10 highest and 10 
lowest scorers on the psychotherapy prediction 
scale were then compared by item-analyzing 
the composite adjective list for the two groups. 
The adjectives which showed a statistically sig- 
nificant difference (.05 level) between high 
and low scorers are listed below. (The staff 
observers were, of course, in ignorance of the 
test scores of the subjects. ) 


a. Adjectives checked more frequently 
high-scoring subjects: alert, adventurous, deter- 
mined, independent, initiative, outspoken, persistent, 
reliable, resourceful, responsible. 

b. Adjectives checked more frequently about low- 
scoring subjects: affected, dependent, 
mannerly, mild. 


about 


effeminate, 


The general impression conveyed is of great- 
er resourcefulness, vitality, and self-direction 
in the high scorers, and effeminacy, inhibition, 
and affectation in the low scorers. This picture 
is supported by staff ratings of these same sub- 
jects on a number of psychological variables 
which it was thought could be inferred from 
social behavior in the assessment setting. The 
psychotherapy prediction scale correlated sig- 
nificantly with Vitality (.38) , which was defined 
simply as “general energy level,” and with 
Drive (.41), defined as “persistence, resolu- 
tion, perseverance, directed energy.” In addi- 
tion, the scale showed low but positive cor- 
relation with several other variables descrip- 
tive of effective functioning. These are: Self- 
confidence (.24), Poise (.24), and Breadth of 
Interest (.25). Significant negative correla- 
tions are with Submissiveness (—.40), Effem- 
inacy (—.34), and Intraceptiveness (—.34). 
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As in the adjective descriptions, the high scor- 
ers on the scale emerge as more adequate phys- 
ically, more at ease socially, and somewhat 
broader culturally. Low-scoring men are effem- 
inate, submissive, and inclined to turn inwards 
rather than to be emotionally outgoing. 

The relationship of the prediction scale to 
intelligence was next investigated. Among the 
functions of the ego, as described by psycho- 
analytic writers and summarized by Fenichel 
[4], are perceiving, planning, synthesizing, 
and, in general, bringing the subject into an 
adaptive relationship to reality. Ego-deter- 
mined behavior is what we are accustomed to 
calling intelligent behavior. Any scale which 
purports to measure ego-strength should be 
positively correlated with standardized meas- 
ures of intelligence. 

In the sample on which the scale was de- 
veloped, its correlation with Wechsler-Belle- 
vue IQ is .44. In the Air Force officer sample, 
the scale correlates .36 with total score on the 
Primary Mental Abilities test, and .47 with 
the Intellectual Efficiency scale of the Cali- 
fornia Psychological Inventory. In that same 
sample it correlates .48 with the Potential Suc- 
cess scale developed at the Institute of Person- 
ality Assessment and Research against a cri- 
terion consisting of faculty ratings of the prob- 
able professional success of the doctoral candi- 
dates studied. In the graduate student sample 
itself, the psychotherapy prediction scale cor- 
relates .39 with intelligence as measured by the 
Miller Analogies Test. Further, in the latter 
sample it correlates .52 with the Intellectual 
Efficiency scale. Thus it relates to general in- 
telligence, as measured by a variety of tests, 
even in highly restricted ranges of intelligence. 
Certainly the ego-strength interpretation of 
the scale is supported. 

The scale also is related to tolerance and 
lack of ethnic prejudice. In the standardization 
sample it correlates —.47 with the Ethno- 
centrism (£) scale of Form 60 of the Univer- 
sity of California Public Opinion Study Ques- 
tionnaire. In the graduate student sample it 
correlates —.35 with the Prejudice scale [5] 
of the MMPI, and —.46 with the E scale. 
Its correlation with the E scale in the Air 
Force officer sample is —.23, and its correlation 
with the Tolerance scale of the CPI in that 
sample is .42. 
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Again, these findings lend some weight to 
the notion that what is being measured is gen- 
eral excellence of ego-functioning. The authors 
of The Authoritarian Personality [1}, in their 
successful search for the character defects 
which accompany ethnocentrism, found that 
high scorers on the E scale show “lack of dif- 
ferentiation of the ego.” This is manifested 
among clinic patients [7], in “a narrow range 
of experience, emotionally and intellectually,” 
together with “rigidity and _ constriction,” 
“stereotyped thinking,” and so on. All of these 
things are thus, by inference, negatively related 
to scores on the psychotherapy prediction scale. 

The relationship of the scale to the diag- 
nostic and validity scales of the MMPI was 
determined in both the graduate student sam- 
ple and the diagnostic study cases. The results 
are shown in Table 1. Surprisingly high nega- 
tive correlations are found with most of the 
measures of psychopathology, averaging in the 
neighborhood of —.60 with Hypochondriasis, 
Depression, Hysteria, Psychasthenia, and Schi- 
zophrenia, and around —.50 with Paranoia in 
the clinical samples. What this suggests is that 
the prediction scale is picking up a general fac- 
tor of psychopathology in the MMPI, reflect- 
ing degree of maladjustment or ego-dysfunc- 
tion irrespective of differential diagnosis. In 
other words, it is related to general elevation 
of the profile, regardless of the pattern. 


Table 1 
Relationship of Ego-strength Scale to Diagnostic 
and Validity Scales of the MMPI 
in Clinic and Student Populations 














A. Male B. Male C. Female 

Clinic Graduate Clinic 

Patients Students Patients 

Scale (N50) (N=36) (N=77) 
F -49 —.36 -.47 
K 31 31 31 
Hs —.62 —.67 -.63 
D -.60 —.53 —.67 
Hy -—.39 ~.61 -.63 
Pd —.48 —-.07 —.34 
Mf —.04 —.43 .07 
Pa —.62 ~.07 -A9 
Pt -.71 —.54 -.71 
Sc —.55 ~44 —.64 
Ma —.04 —.33 -.21 





The correlations are, of course, partly a 
function of overlap of items (generally scored 
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in the reverse direction) between the predic- 
tion scale and the diagnostic scales. The 
amount of net overlap for each scale is shown 
in Table 2. The very fact of overlap itself 
testifies to the character of the scale as a meas- 
ure of general excellence of ego-functioning, 
manifested in this instance by absence of chron- 
ic psychopathology. 


Table 2 


Item Overlap of Ego-strength Scale 
and MMPI Diagnostic Scales 











FO 3 
aes ss : 
2s 
s —4ab GOs ° 
a afR S56 z 
Hs None 2, 43, 51, 62, Seven items, 
. 153, 189, 192 scored opposite 
D 58,241 2, 32, 36,43, 51,153, Eight items, 
189, 208,236,270 scored opposite 
Hy 253 2, 32, 43, 51, 109, 153, Nine items, 
174, 189,192, 234 scored opposite 
Pd 82 32, 33, 94,231,244 Four items, 
scored opposite 
Pa None 109, 341 Two items, 
scored opposite 
Pt None 22, 32, 36, 94, 189, Nine items, 
217, 344, 349, 359 scored opposite 
Sec None 22, 187, 192, 241, Six items, 


251, 349 
Ma 109, 181 22, 100, 251 


scored opposite 


One item, 
scored opposite 





The scale has not yet been put in a 7-score 
form which would be comparable to the profile 
scores of other MMPI scales. This is princi- 
pally because no representative sample of nor- 
mal records has been available to the writer. 
The raw score means and standard deviations 
of the samples studied are presented in Table 
3, however. The values are fairly consistent in 
the clinical samples, with somewhat higher 
means for the graduate students and Air Force 
officers. 

It would be justifiable, of course, to deter- 
mine T scores on the basis of the clinic samples 
alone, provided that the scale is to be inter- 
preted solely as a Psychotherapy Prognosis 
scale for use in an outpatient clinic. In Table 4, 
a chart is given for conversion of raw 
scores into J scores when the scale is used 
only for such prediction purposes rather than 
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as a measure of ego-strength in the general 
population. 


Table 3 


Ego-strength Scale Statistics 

















Sample N Range Mean SD 

1. Standardization sample 33 15-62 41.94 13.30 
2. ist cross-validation 

sample* 53. 26-58 40.10 7.62 
3. 2nd cross-validation 

sample 52 23-60 41.04 8.18 
4. 3rd cross-validation 

sample 46 22-61 42.06 9.32 
5. Clinic diagnostic cases 127 23-60 41.97 7.36 
6. VA mental hygiene 

clinic patients 52 22-59 41.79 7.38 
7. LP.A.R. graduate 

students 40 37-60 50.92 5.62 
8. Air Force officers 160 38-60 52.73 4.05 

* Scores on abbreviated ry ssusebed fen tenant of 
scale. 

Table 4 


Conversion Table for Use of Ego-strength Scale 
in Clinic Samples 














Raw Score T Score RawScore T Score 








22 25 +6 $7 
23 27 47 58 
24 29 48 59 
25 30 49 60 
26 32 50 62 
27 33 51 63 
28 34 52 64 
29 36 53 65 
30 37 54 67 
31 . 38 55 68 
32 39 56 69 
33 40 57 70 
> 42 58 7 

35 43 59 73 
36 44 60 74 
37 45 61 75 
38 47 62 76 
39 48 63 78 
40 49 64 79 
41 50 65 80 
42 52 66 82 
43 53 67 83 
+4 54 68 85 
45 56 





Cross-validation of the Scale as a 
Prediction Instrument 


The prediction scale was tested on three 
new samples of psychotherapy patients, in order 
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to see whether it was doing the job for which 
it was designed. The patients were psycho- 
neurotic, the psychotherapy was brief (very 
close to six months in all cases), and the clinical 
setting was similar to that in which the scale 
was developed. All of the patients took the 
MMPI at the beginning of therapy, and all 
were rated as to degree of improvement at 
some date following termination of therapy. 
The three cross-validating samples are de- 


scribed below. 


1. Fifty-three patients who were given psycho- 
therapy because of delayed recovery from injury or 
physical disease. Ratings of improvement were 
made by expert judges (who had not taken part in 
the therapy) on the basis of terminal interviews. 
At a final rating conference, these 53 patients were 
ranked in terms of degree of improvement. This 
sample of patients had been studied some six years 
earlier by Harris and Christiansen [6], who showed 
that patterns of test scores on both the Rorschach 
and the MMPI were predictive of improvement. 
The same pretherapy MMPI’s were now scored on 
the prognosis scale. Only 39 items of the 68 could 
be used, however, as these patients had been given 
a shortened form of the MMPI, containing only the 
items which make up the clinical and validity scales 
of the test. The corre!ation with terminal rating is 
42. 

2. Fifty-two patients who had received brief psy- 
chotherapy during the preceding five years at Lang- 
ley Porter Clinic. The sample was obtained by ask- 
ing therapists who had worked at the clinic during 
that period of time to nominate patients whom they 
remembered as clear examples of exceptional im- 
provement, complete lack of improvement, and mod- 
erate improvement. The latter group consisted of 27 
paticats, while the two extreme groups numbered 9 
and 16 respectively. The degree of relationship be- 
tween pretherapy prognosis scale scores and this 
trichotomy, as determined by computation of ¢éfa, 
is .54. The means were as follows: Unimproved, 
32.75; Improved, 43.07; Exceptional Improvement, 
49.66. 

3. Forty-six patients who were part of the cur- 
rent patient load on the psychiatric service of a 
general hospital. All of these patients had had ap- 
proximately six months of psychotherapy at the 
time the rating was obtained. Ratings were made 
by the therapists themselves, on a 9-point scale of 
improvement. The correlation with pretherapy prog- 
nosis scale scores is .38. 


These correlation coefficients are of about 
the magnitude that one would expect for a 
scale which is giving a valid measure of patient 
variables related to outcome of psychotherapy. 
It is reasonable that there should remain con- 
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siderable unaccounted-for variance, quite apart 
from whatever error variance is contributed by 
the fallible criterion and predictor measure; 
for there are many important determinants of 
outcome of therapy besides the personality of 
the patient. The personality of the therapist, 
e.g., is also important; and, in addition, there 
is a subtle interactional factor which results 
from the combination of a particular patient 
with a particular therapist, which is not infre- 
quently the crucial determinant of outcome in 
a given case. Then there are, of course, life- 
situational variables outside of the therapy, af- 
fecting both patient and therapist, individually 
or jointly. It seems safe to say that no stand- 
ardized test is likely to achieve any very high 
order of correlation with therapeutic outcomes. 
At the same time, the effort to construct meas- 
ures of the different sources of variance tends 
to advance the research problem somewhat, 
and to make new questions answerable. If the 
scale presented here continues to prove effective 
upon further investigation, it opens the way to 
an inquiry into the effect of the therapist’s per- 
sonality, intelligence, and social attitudes upon 
therapeutic results, with the effect of patient 
variables held constant. Beyond that question, 
of course, lies the more difficult problem of 
measuring interactional effects, and their 
unique influence on the therapeutic relation- 
ship. 
Summary and Conclusions 

To recapitulate: an MMPI scale was de- 
veloped for the purpose of predicting response 
to psychotherapy, and upon inspection of its 
item content and its personality and intelli- 
gence test correlates it was interpreted as being 
essentially a measure of ego-strength. It is here 
proposed that the scale be known as the Ego- 
strength scale of the MMPI, and that the con- 
ventional abbreviation for it should be Fs. 

The relationship of the scale scores to thera- 
peutic outcomes in several cross-validating 
samples led to the conclusion that a significant 
determinant of personality change in psycho- 
therapy is strength of the ego before therapy 
begins. Among the characteristics which are 
collectively referred to as ego-strength are phy- 
siological stability and good health, a strong 
sense of reality, feelings of personal adequacy 
and vitality, permissive morality, lack of ethnic 
prejudice, emotional outgoingness and sponta- 
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neity, and intelligence. 

Since the patients who seek psychotherapy 
are almost invariably in some sort of psycho- 
logical difficulty, it must be evident that these 
characteristics are usually not salient features 
of the clinical picture at first contact. The evi- 
dence suggests, however, that such strengths 
are latent in the personality, and that they 
emerge as therapy progresses. By implication, 
it seems probable that the kind of personal 
crisis which brings the person of good ego- 
strength to the clinic is more situation-linked 
and less characterologically based (i.e., less 
chronic) than the personal difficulties of the 
person with poor ego-strength. 

The scale should be useful both as a research 
instrument and as an additional clinical indi- 
cator on the MMPI. The present writer 
would suggest, however, that considerable cau- 
tion should be exercised in the clinical use of 
the scale. Certainly it should not serve as the 
basis for categorical recommendations to treat 
or not to treat certain patients; the grounds 
for such action in a clinic should properly in- 
volve values as well as facts, and in any event 
the kind of crude measuring device presented 
here represents a fairly low order of “‘fact.” 
Any prognostic assertions made on the basis of 
this scale should be quite tentative, and prob- 
ably should be accompanied by a visual image 
of the kinds of scatter plots which may give 
rise to correlations in the general neighbor- 
hood of .45. 

As a research instrument, the scale should 
prove useful in giving some assessment of the 
role of “patient variables” in determining the 
complex outcome which is involved in response 
to psychotherapy. It may also be of some value 
in assessing the kind of change that occurs in 
therapy. One may ask, for example, whether 
there is actually an enhancement of ego- 
strength as a consequence of therapy, and get 
an answer by comparing pretherapy with post- 
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therapy scores on the scale. Or one might in- 
quire whether the therapy itself is causing the 
change for the better in patients who improve ; 
evidence on the issue might be obtained by set- 
ting up a research design which would use as 
a control group a sample of patients who are 
matched with the therapy sample in terms both 
of Es scores and of present need for psycho- 
therapy, but who differ in that they do not 
receive psychotherapy. 

In addition, the scale may be useful as an 
assessment device quite apart from the clinical 
situation. Its correlates with personality vari- 
ables in normal samples are similar to the pat- 
tern of relationships seen in clinic samples, and 
in general it seems to be measuring constructive 
forces in the personality. Thus it may serve 
as a predictor in any situation in which an 
estimate of personal adaptability and resource- 
fulness is called for. 


Received December 11, 1952. 
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The problem of how to evaluate psycho- 
therapy seems often to be complicated by the 
larger problem as to what the goals in therapy 
are, or should be. Nowhere is this problem 
more evident than in the recent article by 
Eysenck [3] who reviewed the literature on 
evaluation of psychotherapy and came to the 
tentative conclusion that the available evidence 
fails to support the notion that psychotherapy 
facilitates recovery from neurotic disorders. To 
reach this interesting conclusion, Eysenck had 
to accept as equal or nearly equal the judg- 
ments of a great number of psychiatrists and 
physicians as to what constitutes cure or im- 
provement. He is probably right in stating 
that his conclusions will be looked on with a 
skeptical eye, although he assumes that it will 
be the result of an emotional block on the part 
of the skeptics rather than any methodological 
weakness leading to his own conclusions. It 
should be clear by now that “success in psy- 
chotherapy” is a value judgment concept, a 
fact which makes it difficult to find a defini- 
tion acceptable to everyone. The real problem 
to the science of psychology is that the many 
discussions and vituperative arguments as to 
what therapy should be have not advanced us 
too much further in our search of what 
therapy is. 


The writer would suggest that there is an- 
other and more profitable way of approaching 
this problem, namely, to demonstrate empiri- 
cally what changes do take place as a result of 
a particular type of therapy. Thus, objective 


1 The data for the present sudy were obtained as 
part of a group research project in psychotherapy at 
the Pennsylvania State College. The coordinated 
portion of the research is being published under the 
title: Group report of a program of research in 
psychotherapy, Psychotherapy Research Group. 
Pennsylvania State College, in press. 


evidence will be available, regardless of wheth- 
er or not it is acceptable to various critics, as 
to what a therapy does do as distinguished 
from what its followers feel it should do. 


Problem 


The present problem is to determine wheth- 
er there were any changes on the results of 
the MMPI after a group of college students 
had undergone client-centered therapy. All of 
the cases, predominantly college students, who 
came to the Psychological Clinic for aid in 
their personal adjustment were minutely ex- 
amined by the group research project in psy- 
chotherapy. Interviews were recorded and 
transcribed, pretests and posttests were ad- 
ministered, therapists’ ratings and various 
judges’ ratings were obtained, etc. The present 
study deals with the MMPI results and their 
relationship with other measures of progress 
in treatment. 

Previous studies. Since the MMPI has been 
a popular diagnostic instrument, research has 
been mainly confined to differential diagnostic 
studies [6, 8, 9, 10, 11, 15], although some 
investigations have been completed on MMPI 
changes as a result of various shock therapies 


[1,5, 7, 13]. 


It has, as yet, seen limited use as a tool for evalu- 
ation of psychotherapy. Rashkis and Shaskin [14] 
used the MMPI to evaluate group psychotherapy of 
a permissive nature. Using a T score of over 70 as 
a measure of deviation from the normal on 22 psy- 
chiatric battle casualities and 15 anxiety state pa- 
tients, they found the greatest changes in the direc- 
tion of improvement in the D, Hy, Hs, and Pt scales. 
The Pd scale remained unchanged and the Ma scale 
showed a tendency to increase. 

Schofield [16], reasoning that a measure of per- 
sonality deviation should also measure changes in 
therapy, compared four groups of women undergo- 
ing different types of therapy with pretherapy and 
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posttherapy MMPI scores. He also attempted to de- 
velop a scale of items from the MMPI which would 
predict amenability to therapy. 

There were two groups of neurotic women, one 
treated on an outpatient basis and the other hospi- 
talized; and two groups of psychotic women, one 
group having electroshock treatment and the other 
having no shock treatment. These groups were dif- 
ferent from the population used in the present study 
in that they had limited education, average intelli- 
gence, were older, and all were women. 

The outpatient neurotic group that was being 
treated by junior medical students showed no sig- 
nificant changes on posttherapy MMPI’s. The hos- 
pitalized psychoneurotics showed significant differ- 
ences on the Hs, Hy, and Pd scales and a general 
lowering effect on the whole profile. The hos- 
pitalized psychotics who had no shock treatment 
showed no significant changes on the posttherapy 
tests, while the psychotics who underwent shock 
treatment showed changes on the F, Hs, D, Hy, Pd, 
Pt, and Sc scales. A group of nonhospitalized nor- 
mal women showed no significant changes on tests 
which were given with the same general time lapse 
as those of the therapy groups. 

Schofield’s attempt to establish a predictive scale 
for therapy was not successful, as there was too 
much overlap on the scale between the much im- 
proved and the slightly improved group. He attrib- 
uted his lack of success to a “lack of a reliable clin- 
ical criterion of patients’ responses to therapy.” 

Wiener and Phillips [18] studied the changes of 
the MMPI on a patient undergoing modified psycho- 
analysis (one hour a week). During a period of 
eight months there was noticed a strong drop in the 
D, Pt, and Sc scales and a moderate drop in the 
Hy and Pa scores. It was also noted that the K 
score went up and that these changes remained 
when the patient was re-examined a year after 
therapy was discontinued. 

Mosak [12] reported the results of 28 clients who 
had undergone cliert-centered psychotherapy for an 
average number of fifteen interviews. He reported 
that the posttherapy MMPI results indicated signi- 
ficant decreases on the D, Sc, Hs, Hy, and Pa 
scales. The individual profiles showed the same 
pattern as was observable on the pretherapy tests 
with a general drop in scores on all the scales. The 
Bell Adjustment Inventory, also given to the same 
clients, showed significant improvement in the feel- 
ings toward the self and toward others. 


Hypotheses. The following hypotheses were 
tested in the present study. 

1. Changes that take place as a result of 
any type of psychotherapy should be reflected 
in subsequent changes in the results of person- 
ality tests. As there is a change in the direc- 
tion of health in the individual, there should 
be a corresponding depression in the scores 


that represent maladjustment. 

2. It was expected that the greater the move 
to health in the individual, the greater the ex- 
pected change in the personality tests toward 
health. Thus, a positive correlation between 
change in maladjustment scores on the MMPI 
and the criterion measures of success in psycho- 
therapy was expected. 

Method 
Subjects 

The 41 subjects involved in this study were 
all students of the Pennsylvania State College 
whe came to the Psychological Clinic between 
September 1949 and August 1950, either by 
request of various agencies or upon their own 
volition, to obtain aid in their personal ad- 
justment. All these subjects were counseled 
by advanced graduate students in clinical psy- 
chology who had been trained in client-centered 
therapy. No attempt was made to diagnose 
these cases prior to therapy except that persons 
judged as prepsychotic or psychotic on the 
basis of initial contacts were transferred to the 
staff psychiatrist. The median number of 
therapy interviews was between five and six, 
although some cases were seen for a much 
longer period of time. 

Figures obtained from the registrar of the 
college for the year 1949-1950 showed that 
the group who came for therapy was repre- 
sentative of the total college population for 
the semester enrolled, in age (mean = 21.75) 
and sex (75% males). There was a higher 
proportion of liberal arts students in the 
therapy group than in the general college pop- 
ulation. No evidence was available to suggest 
why this was so. 

Raw MMPI scores of 202 randomly select- 
ed college students were used as a typical col- 
lege normative group with which to compare 
the therapy population. The mean raw scores 
for each of the MMPI scales was obtained 
and then converted into a T' score so that some 
comparison would be possible. It would have 
been desirable to have a control group of mal- 
adjusted students who did not undergo psy- 
chotherapy. However, practical considerations 
militated against such a procedure at this time. 

Procedure. A battery of tests consisting of 
the Rorschach, MMPI, and the Mooney Prob- 
lem Check List was given to each of the 
subjects before the beginning of the therapy 





336 


interviews or, at the latest, before the second 
therapy interview. The posttherapy tests were 
given after an agreement was reached by the 
therapist and client that the therapy contacts 
should end. 

In order to correlate the change on the 
MMPI with other measures of success, a mal- 
adjustment scale was developed to give one 
score which would represent the amount of 
deviance from the normal in each case. To 
obtain this score the deviant scores on all the 
items on the Hs, D, Hy, Pd, Pa, Pt, and Sc 
scales were summed. The Mf and Ma scales 
were not included because norms on college 
students revealed these scales to be unduly ele- 
vated. The procedure of summing the in- 
dividual items was done in preference to sum- 
ming the 7" scores, since some items appear on 
more than one scale and would be unduly 
weighted by such a procedure. 


The therapy criterion measures. A multiple 
criterion for evaluating client-centered psycho- 
therapy with college students was developed by 
Tucker [17] using the cases in the present 
group. This multiple criterion consisted of 
four measures: 

1. A 29-item Therapy Rating Scale scored 
by the therapist following the end of contacts 
with the client. 


2. The same Therapy Rating Scale scored 
by judges who read at least 60% of the tran- 
scribed interviews including the first and last 
interviews. 


3. A 14-item Client Rating Scale which the 
client filled out at the time he took the post- 
therapy test battery. 

4. The ratio of negative to positive feelings 
in the final interview as compared to the ratio 
of negative to positive feelings in the first in- 
terview. 

These four criterion measures were com- 
bined into a total criterion score by weighting 
each measure according to the ratio of its 
summed intercorrelation with the other three 
measures. All of the rating scales were con- 
structed especially for this study by members 
of the group research project. For further in- 
formation concerning the reliability of judges’ 
ratings, the construction of rating scales, etc. 
the reader is referred to Tucker’s original work 


[17]. 
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Table 1 
Pre- and Posttherapy MMPI Scores on Therapy 
Group Compared with Random Sample Group 
of College Students 











Random 
MMPI Pretherapy Posttherapy Sample 
Scale Mean Mean Mean 
T score T score T score 
N=41 N41 N=202 
F Mean 57.92 55.45** 57T 
Sigma 7.73 6.91 
K Mean 53.05 55.34** 53 
Sigma 6.45 8.89 8 
Hs Mean 55.17 51.71** 47 
Sigma 12.85 9.28 
D Mean 67.10 60.88* 50 
Sigma 12.51 12.54 6 
Hy Mean 60.66 59.54 56 
Sigma 10.89 8.56 
Pd Mean 62.49 61.17 53 
Sigma 13.48 10.03 
Pa Mean 56.67 55.22 53 
Sigma 8.29 9.33 8 
Pt Mean 67.49 63.49* 47 
Sigma 8.52 11.83 14 
Sc Mean 64.43 62.20 49 
Sigma 12.72 11.68 11 
Ma Mean 57.17 58.97 57 
Sigma 7.98 7.70 11 
Si Mean 59.94 55.03* 
Sigma 11.32 10.02 
Mal. Meant 86.56 79.41* ai 
Sigma 17.51 18.04 ate 





t Mean raw scores. 

+ Estimated T scores on the basis of raw score data. 

* Difference between pretherapy and posttherapy sig- 
nificant af 1% level of confidence. 

** Difference between pretherapy and posttherapy sig- 
nificant at 5% level of confidence, 


Results 

1. Table 1 shows significant differences be- 
tween pretherapy and posttherapy mean T 
scores on the F, K, Hs, D, Pt, and Si scales. 
There was also a significant difference between 
groups on the maladjustment scale constructed 
especially for this study. These mean changes 
include, of course, a great variety of individual 
changes. Some cases showed a 30 to 40 T- 
score improvement on certain scales while 
others, surprisingly enough, showed an upward 
surge in their profiles. It was the opinion of 
most therapists handling such cases that such 
an upward surge was indicative of a break- 
down of defenses and the individual’s greater 
awareness of his problems, rather than an in- 
dication of a sudden turn to greater maladjust- 
ment. 
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2. All the scales, with the exception of K 
and Ma, showed a tendency to be lower on 
the posttherapy test. This finding agrees with 
Mosak, who reported a general lowering of 
all scales as a result of therapy. 

3. Despite a considerably lower mean score 
on posttherapy results, the mean T' scores of 
the therapy group were still considerably high- 
er than the random sample group of college 
students. This would seem to suggest that a 
sizable amount of improvement might still be 
profitably made with the therapy group. It 
must be remembered that the posttherapy tests 
were given immediately after therapy had been 
completed. There seems to be some evidence 
[2] to suggest that further change and im- 
provement in the client takes place for a period 
after therapy has been completed. 

4. The scales generally regarded as the char- 
acter or behavior disorder scales, Hy, Pd, and 
Ma, showed the least tendency to change as 
a concomitant of client-centered therapy. Con- 
versely the feeling or discomfort scales, D, 
Pt, and Hs, showed the greatest tendency 
towards change. It should be noted that the 
character and behavior disorders have been 
traditionally the group considered least sus- 
ceptible to any kind of psychotherapy and this 
may be more evidence supporting that clinical 
finding, rather than a specific failing of client- 
centered therapy. 


Table 2 


Correlation of MMPI Maladjustment Change Score 
with Client-Centered Therapy Criteria + 














Criterion Maladjustment 
measure change score 
Therapist Rating 15 
Judge Rating 33 
Client Rating .58* 
P-N Feeling Ratio A4** 
Multiple Criterion 41** 





+ N= 30. 
* Significant at 1% level. 
** Significant at 5% level. 


5. Table 2 shows the correlation of MMPI 
maladjustment change scores with the various 
criterion measures developed by Tucker. Al 
though there is a positive correlation with all 
four criterion measures, only the Client Rat- 
ing Scale and the Positive-Negative Feeling 
Ratio showed significant correlations with the 
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Maladjustment Change Scores. This would 
seem to represent another example of the phe- 
nomenon mentioned previously by Tucker [17 ] 
and Gallagher [4], that the client’s evaluation 
of his progress and the psychologist’s judgment 
of the client’s progress are fairly independent 
of each other. Since the MMPI is, by and 
large, a measure of self-evaluation, we would 
expect fairly high correlations between MMPI 
changes and Client Rating Scales and Positive- 
Negative Feeling Ratios. Similarly, we might 
expect low correlations between the therapist 
and judge’s ratings and the MMPI change 
scores, and this is what happened. 


Discussion 


The results of the present study seemed to 
indicate that there were some changes, as 
measured by the MMPI, taking place in a 
group of college students concomitant with 
client-centered therapy. It should be noted al- 
so that considerable changes took place despite 
two unfavorable factors present in this study: 
first, the use of relatively inexperienced thera- 
pists, and second, a shorter number of inter- 
views than is generally accepted as necessary 
to accomplish real change in a client. 

Also of interest was the fact that some scales 
were more susceptible to change than others. 
Generally it was the mood or feeling scales 
which showed the greatest change in the direc- 
tion of health, while the behavior or character 
disorder scales showed the least amount of 
change toward health. While this is generally 
true of all types of psychotherapy, consistent 
results along this line would suggest that those 
patients who show initially high scores in the 
behavior disorder scales might profitably be 
handled in some other fashion than by being 
submitted to psychotherapy, in this case, client- 
centered psychotherapy. 

Another finding of interest was that there 
seem to be two different and relatively in- 
dependent frames of reference towards success 
in psychotherapy; the client’s frame of refer- 
ence in which he estimates change that has oc- 
curred within himself, and the therapists’ 
frame of reference in which they estimate the 
amount of change that has taken place within 
the individual. While we, as psychologists, 
would like to believe that our expert opinions 
are more accurate and more realistic in the 
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evaluation of actual change, it does not neces- 
sarily follow that this is so. Some further 
study in which the opinion of both client and 
therapist are checked against some observable 
behavioral change in the client would do much 
to clear up this problem. 

The existence of such different frames of 
reference would pose a particular problem for 
client-centered therapy, for if the client is to 
have the final and irrevocable decision as to 
when he will leave therapy, he may often leave 
a rather frustrated therapist behind, who feels 
that the client has escaped therapy with only 
some anxiety reduction rather than a perma- 
nent solution or adaptation to his problem. 
Certainly some effort needs to be made to 
bring these frames of reference into closer con- 
junction with each other. 


Summary 


Forty-two college students who underwent 
client-centered therapy from advanced gradu- 
ate students in clinical psychology were given 
a pretherapy and posttherapy battery of tests, 
one of which was the MMPI. The purpose 
of the present study was to determine if there 
were any changes in the MMPI concomitant 
with the application of therapy and to see how 
well the changes on the MMPI compared with 
a multiple criterion of success in therapy. 

The results showed significant differences in 
the direction of health on six of the MMPI 
scales with the greatest differences being shown 
on the feeling or mood scales, while the least 
differences were shown on the character and 
behavior disorder scales. The MMPI malad- 
justment change scores showed significant cor- 
relations with measures of self-rating of suc- 
cess in therapy and of change in ratio of posi- 
tive and negative feelings from beginning to 
end of therapy. 


Received January 23, 1953. 
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An Adjustment Score for Q Sorts 
Rosalind F. Dymond 


Counseling Center, University of Chicago 


One of the most serious of the difficulties 
faced by those who would undertake research 
on the results of psychotherapy is the selection 
of suitable criteria. The person who presents 
himself for therapy presumably feels in need 
of change. Therefore, to measure the effects 
of the therapy, there must be some method of 
assessing his status before and after therapy, 
and some explicit standard against which the 
change, if any, may be measured. Such a cri- 
terion measure would also make possible group 
comparisons such as the initial adjustment sta- 
tus of an experimental or therapy group in 
comparison to a no-therapy group, and the 
comparative standing of these two groups after 
the experimentals have completed their thera- 
peutic inter..ews. 


To provide one such measure for the pro- 
gram of research in therapy under way at the 
Counseling Center of the University of 
Chicago,’ the Q-sort adjustment score was de- 
vised. The Q-sort instrument itself has al- 
ready been briefly described in this series [1]. 
It is a test made up of 100 self-referent state- 
ments which each subject was asked to dis- 
tribute into nine piles, putting a prescribed 
number of cards into each, making a forced 
normal distribution. The instructions are that 
he put the cards most descriptive of him as he 
sees himself at one end, and the least descrip- 
tive at the other, with the items about which 
he is indifferent or undecided falling at the 
center. The required distribution is as follows: 


1This is one of a series of articles reporting a 
large-scale research program in psychotherapy and 
personality, which is being conducted by the staff 
of the Counseling Center of the University of Chi- 
cago. This research program is largely supported 
by grants from the Rockefeller Foundation through 
its Medical Division. Numbers I, II, and III in the 
series appeared in the Psychological Service Center 
Journal, 1951, 3, 3-165. 
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Most like me 


Pile no. 0 1 2 3 4 5 6 7 8 
No. of cards 1 4 11 21 26 21 11 4 1 


Least like me 


The statements to be distributed were com- 
piled by John Butler and Gerard Haigh* from 
therapeutic interviews so as to represent both 
the positive and negative statements that clients 
frequently make about themselves. As has been 
outlined by Grummon [1], both the experi- 
mental and control subjects in the research on 
Block I sorted these cards at various times. 
To review the design briefly, Block I of this 
program involved an experimental group of 
twenty-five cases selected randomly from those 
presenting themselves for therapy and a con- 
trol group of equal size of “normals.” The 
control group is normal in the sense that they 
had never had any psychotherapy and were 
not at the time of selection so motivated. They 
were individually matched with the experi- 
mental subjects on age, sex, socioeconomic 
status, and occupation. To control for the pos- 
sible effect of the passage of time, the tests 
for the controls were spaced at the same in- 
tervals as those of the therapy cases with whom 
they were matched. This also gives control over 
the possible effect of repeated testing. There 
was no attempt to match on such factors as 
psychological status, personality variables, or 
motivation for therapy. These were handled by 
using an “own-control” design as well. The 
experimental (therapy), and the control (no- 
therapy) groups were each subdivided into an 
A and a B category. The experimental 4’s 
were given a battery of tests two months before 
their therapy began, and again just before their 


2 Haigh, G., & Butler, J. Proposal for research on 
changes in perception of self and others in therapy. 
In First interim report of the Rockefeller research 
project. Univer. of Chicago, unpublished manu- 
script, pp. 12-15. 
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therapy started. This made available a measure 
of their pretherapy psychological status, and 
also permitted a comparison of their prewait 
and pretherapy tests to reveal the extent to 
which a group motivated to seek therapy would 
change in a positive direction, in a two-month 
interval, without the help of therapy. A posi- 
tive shift between these two sets of test scores 
in the experimental group during the no-ther- 
apy waiting period would indicate that the im- 
portant variable in “improvement” is not the 
therapy but the motivation. However, if the 
control group which is not motivated for ther- 
apy were to show a shift of the same magni- 
tude, the change might better be attributed to 
the practice effect resulting from retesting. 


The experimental B group had no waiting 
period but was first tested just before its ther- 
apy began. As the control sample was tested at 
the same time intervals as its experimental 
match, for half the sample of both experiment- 
als and controls there were four sets of tests: 
prewait, pretherapy, posttherapy, and follow- 
up (six months after the posttherapy tests). 
For the other half, there were three testing 
points: pretherapy, posttherapy, and follow-up. 


To obtain an adjustment criterion against 
which any particular person’s distribution of 
the cards could be scored, the entire group of 
100 statements was given to two well-trained, 
practicing clinical psychologists from outside 
the client-centered orientation. They were 
asked to sort the statements into two piles, 
those the well-adjusted person should say are 
like him, and those the well-adjusted person 
should say are unlike him. Both judges felt 
that some items were irrelevant to one’s adjust- 
ment status, and were permitted to omit these 
items from their sortings. The two distribu- 
tions made by the two judges agreed remark- 
ably well, differing on only 2 of the 100 items. 
Next, the 26 statements which the initial two 
judges agreed did not differentiate adjustment 
were discarded, and four new judges were 
given the remaining 74 to sort. The new judges 
were asked to make two equal piles, so that 
there would be 37 items that the well-adjusted 
individual would say are like him, and 37 he 
would say are unlike him. Again the agreement 
among the judges’ sortings was very high. 
Only one judge differed on the placement of 
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as many as four items. The composite picture 
of the self-description of the well-adjusted per- 
son was then tabulated as 37 positive indicators 
on the “like me” side of the distribution (from 
scale position 5 to 8), and 37 negative indi- 
cators on the “unlike me” side (between 3 and 
0). Table 1 lists these items. 


Table 1 


Adjustment Score Items 











Negatives: Contribute to score if fall on “unlike 
me” side (0-3) 


I put on a false front. 

I often feel humiliated. 

I doubt my sexual powers. 

I have a feeling of hopelessness. 

It is difficult to control my aggression. 

I want to give up trying to cope with the 

world. 

I tend to be on my guard with people who a e 

somewhat more friendly than I had expected. 

8. I usually feel driven. 

9. I feel helpless. 

10. My decisions are not my own. 

11. I am a hostile person. 

12. I am disorganized. 

13. I feel apathetic. 

14. I don’t trust my emotions. 

15. It is pretty tough to be me. 

16. I have the feeling that I am just not facing 
things. 

17. I try not to think about my problems. 
I am shy. 

19. I am no one. Nothing seems to be me. 

20. I despise myself. 

21. I shrink from facing a crisis or difficulty. 

22. I just don’t respect myself. 

23. I am afraid of a full-fledged disagreement 
with a person. 

24. I can’t seem to make up my mind one way or 
another. 

25. I am confused. 

26. I am a failure. 

27. I am afraid of sex. 

28. I have a horror of failing in anything I want 
to accomplish. 

29. I really am disturbed. 

30. All you have to do is just insist with me and 
I give in. 

31. I feel insecure within myself. 

32. I have to protect myself with excuses, with 
rationalizing. 

33. I feel hopeless. 

34. I am unreliable. 

35. I am worthless. 

36. I dislike my own sexuality. 

37. I have few values and standards of my own. 


Owns wh 
res. 2 © 


| 


An Adjustment Score for Q Sorts 


Positives: Contribute to score if fall on “like me” 
side (5-8) 
1. I am likeable. 


2. My personality is attractive to the opposite sex. 
3. I am relaxed and nothing really bothers me. 
4. I am a hard worker. 

5. I feel emotionally mature. 

6. I am intelligent. 

7. I am self-reliant. 

8. I am different from others. 

9. I understand myself. 

10. I am a good mixer. 

11. I feel adequate. 

12. I am satisfied with myself. 

13. I am assertive. 

14. I take a positive attitude toward myself. 
15. I have initiative. 

16. I am ambitious. 

17. I have an attractive personality. 

18. I am tolerant. 

19. Iam a rational person. 
20. I am impulsive. 

I 


am poised. 

22. I am contented. 

23. I can usually make up my mind and stick to it. 

24. I am sexually attractive. 

25. I am liked by most people who know me. 

26. I am optimistic. 

27. My hardest battles are with myself. 

28. I can usually live comfortably with the people 
around me. 

29. I express my emotions freely. 

30. I usually like people. 

31. Self-control is no problem to me. 

32. I can accept most social values and standards. 

33. I am a responsible person. 

34. I have a warm emotional relationship with 
others. 

35. I often kick myself for the things I do. 

36. I am responsible for my troubles. 

37. I make strong demands on myself. 





Any person’s resemblance to this ideal type can 
be computed by counting the number of the 74 
items which he places on the appropriate side of 
the distribution when describing himself. This 
tally was called the adjustment score. 


Table 2 


Adjustment Score of “A” Group in the 
No-Therapy Period 











Experimental Control 
Test group group 

(N= 11) (N = 11) 

Mean’ Range Mean’ Range 
Prewait 28.7 16-36 47.0 25-58 
Pretherapy 31.2 1441 47.4 27-58 
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Results 


The mean adjustment score of the members 
of the experimental 4 group at the prewait 
testing time showed that they described them- 
selves as significantly poorer in adjustment 
than the no-therapy group, as indicated by the 
t test. The mean adjustment score of neither 
the experimental nor the control 4 group 
changed significantly over the waiting period, 
and the two remained significantly different at 
the 1 per cent level (Table 2). Thus neither 
motivation to change nor familiarity with the 
test seemed to be sufficient in itself to produce 
a significant increase in adjustment score dur- 
ing the two-month waiting period. 

Although the control testing program is not 
yet complete, a comparison of the 15 completed 
cases with the 25 experimentals can be made 


(Table 3). 
Table 3 


Adjustment Score of Total Group over the 
Therapy Period 











Experimental Control 
Test group group 

(N= 25) (== 15) 

Mean’ Range Mean’ Range 
Pretherapy 28.9 11-42 47.4 27-60 
Posttherapy 39.9 17-54 45.6 27-56 





In comparing the pre- and posttherapy mean 
scores, the experimentals are found to increase 
their adjustment scores significantly over the 
therapy peried, whereas the no-therapy group 
does not. At the posttherapy testing time, the 
experimental group mean is not significantly 
different from the control group mean. 


In sum, the group which presumably was 
motivated to change in some way described 
themselves as poorer in adjustment than a 
group that was not so motivated. With the 
intervention of therapy, this group described 
themselves as psychologically better in adjust- 
ment than previously, and approached the level 
of a “normal” group without the therapy ex- 
perience. 


Discussion 


How good a criterion is the Q-sort meas- 
ure? As this is a self-descriptive measure of 
adjustment, how well does it agree with a 
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more “objective” measure? Table 4 shows the 
relation of the Q-sort adjustment score to the 
counselor’s rating of the success of the therapy. 
Using Yates’s exact method for determining 
the significance of the relationship, it was 
found to be significant at the 5 per cent level. 


Table 4 


Relation of Q Adjustment Score of Experimental 
Group after Therapy and Counselor’s 
Rating of Success 








Success rating 





Q Adjustment Low High 
score 1-5 6-9 
Low 
(17-38) 7 4 
High 
(39-54) 3 11 





It may be argued that these two measures 
are not independent of each other and that 
neither is a valid measure of adjustment. The 
counselor’s judgment of the success of the 
therapy may be influenced by the client’s use 
of well-adjusted self-references in the inter- 
views, and the therapist’s attitude of satisfac- 
tion with the progress may be communicated 
to the client who then reflects it in his self- 
description. There is some possibility that the 
adjustment score of the follow-up sort may 
contribute an answer. If the client’s postther- 
apy self-description was greatly influenced by 
a “need to please” the therapist, or even to 
prove to himself that he had profited from the 
time spent in therapy, some of this motivation 
should have been reduced in the intervening 
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six months. If the gains from therapy were 
really superficial or minimal and the adjust- 
ment score increase wholly spurious, the self- 
description done six months after therapy 
might be expected to be somewhat less influ- 
enced by the “hello-goodbye effect” [2, p. 
228]. The fact that the mean follow-up ad- 
justment score of the therapy group, based on 
22 completed cases, is almost identical (38.3) 
to the posttherapy mean (39.9) seems to indi- 
cate some lasting improvement. The follow-up 
tests of the control group are not yet complete 
enough to report. 


Summary 


An index of adjustment based on a Q-sort 
technique shows a group of persons presenting 
themselves for therapy to be less well-adjusted, 
as measured against a criterion set up by expert 
clinicians, than a group who do not wish ther- 
apy. After therapy there is a significant im- 
provement in the experimental group, which 
is then not significantly different from the no- 
therapy group. There is, further, a significant 
concurrence between counselors’ judgments of 
the success of the therapy and the final adjust- 


ment status as measured from the self-descrip- 
tion. 


Received January 26, 1953. 
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The Appraisal of Body-Cathexis: Body-Cathexis 
and the Self 


Paul F. Secord and Sidney M. Jourard 


i 


A substantial amount of current research in 
personality is devoted to the study of the in- 
dividual’s personal world. One object which is 
ever-present in this personal world is the body. 
It is the thesis of the prescnt writers that the 
individual’s attitudes towards his body are of 
crucial importance to any comprehensive theory 
of personality; yet little attention has been 
given to this subject by psychologists. The 
present paper is concerned with one variety 
of attitude, namely, body-cathexis. By body- 
cathexis is meant the degree of feeling of sat- 
isfaction or dissatisfaction with the various 
parts or processes of the body. 

If the variable body-cathexis is to be deemed 
important for personality theory, it is neces- 
sary to demonstrate that it is related to other 
personality variables which are recognized as 
significant. For reasons which need not be dis- 
cussed here, body-cathexis is believed to be in- 
tegrally related to the self-concept, although 
identifiable as a separate aspect thereof. From 
this notion of relatedness of body and self, the 
following more specific hypotheses were formu- 
lated and tested: 

1. Feelings about the body are commensu- 
rate with feelings about the self, when both are 
appraised by similar scales. 

2. Negative feelings about the body are as- 
sociated with anxiety, in the form of undue 
autistic concern with pain, disease, or bodily 
injury. 

3. Negative feelings about the body are as- 
sociated with feelings of insecurity involving 
the self. 


One of the few empirical studies relevant to the 
present focus is that of Schilder [4], who used a set 
of questionnaires which probed the feelings, associa- 
tions, and memories of his patients toward various 
aspects of their bodies. These semiobjective ques- 
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tionnaires suggested the more objective scale em- 
ployed in the present study. Another relevant paper, 
that of Secord [6], describes the use of a homonym 
word-association technique for the appraisal of 
body-cathexis in a disguised “projective” fashion. 
This technique was used here for purposes of com- 
parison with the more direct BC-SC Scale. 


The BC-SC Scale 


The writers approached the problem of ap- 
praising body-cathexis (BC) by asking the per- 
son to indicate on a scale the strength and di- 
rection of feeling which he has about each of 
the various parts or functions of his body. Such 
a direct approach, of course, has certain of the 
theoretical disadvantages which the more typi- 
cal self-inventories also possess, but it was be- 
lieved that the technique might have some use- 
fulness in spite of these limitations. The first 
part of this scale consisted of a listing of 46 
body parts and functions. Each item was fol- 
lowed by the numbers 1 through 5. The fol- 
lowing instructions appeared on the cover page 
of the scale: . . 


On the following pages are listed a number. of 
things characteristic of yourself or related to you. 
You are asked to indicate which things you are 
satisfied with exactly as they are, which things you 
worry about and would like to change if it were 
possible, and which things you have no feelings 
about one way or the other. 

Consider each item listed below and encircle the 
number which best represents your feelings accord- 
ing to the following scale: 


1. Have strong feelings and wish change could 

somehow be made. 

Don’t like, but can put up with. 

3. Have no particular feelings one way or the 
other. 

4. Am satisfied. 

5. Consider myself fortunate. 


9 
-- 


The second part of the scale concerned self- 
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cathexis (SC), and listed 55 items believed to 
represent a sampling of the various conceptual 
aspects of the self, which were rated by the 
respondents according to the same instructions 
used for the body scale. The self-traits in- 
cluded were phrased in nontechnical, popular 
terms, such as morals, conscience, and person- 
ality, so that they might approximate the terms 
in which the individual actually thinks of him- 
self. ‘Tables 1 and 2 list the items included in 
both parts. 


Table 1 
Body-Cathexis Items Used in BC Scale 

















hair width of shoulders 
facial complexion arms 
appetite chest 
hands eyes 
distribution of hair digestion 
over body hips 
nose skin texture 
fingers lips 
elimination legs 
wrists teeth 
breathing forehead 
waist feet 
energy level sleep 
back voice 
ears health 
chin sex activities 
exercise knees 
ankles posture 
neck face 
shape of head weight 
body build sex (male or female) 
profile back view of head 
height trunk 
age 
Table 2 
Self-Cathexis Items Used in SC Scale 
first name _ sensitivity to opinions 
morals of others 
ability to express self ability to lead 
taste in clothes last name 
sense of duty impulses 
sophistication manners 
self-understanding handwriting 
life goals intelligence level 
artistic talents athletic skills 
tolerance happiness 
moods creativeness 
general knowledge love life 
imagination strength of conviction 
popularity conscience 
self-confidence skill with hands 
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ability to express fears 
sympathy capacity for work 
emotional control conscientiousness 


self-consciousness ability to meet people 
generosity self-discipline 
ability to accept criticism suggestibility 


thoughts neatness 

artistic & literary taste vocabulary 

memory procrastination 
thriftiness will power 

personality self-assertiveness 
self-respect ability to make decisions 


ability to concentrate dreams 


ability to take orders 





The form of the scale presented in Tables 
1 and 2 is the result of considerable prelimi- 
nary work in which previous forms were tried 
out on college students. Items which were 
difficult to understand, difficult for the subject 
to assign a meaningful rating, or which re- 
sulted in little variability from subject to sub- 
ject were generally eliminated, provided that 
they did not leave an important part or the 
body or self unrepresented. One exception to 
the latter qualification was allowed: organs 
pertaining to sexual and excretory functions 
were deliberately omitted from the body list 
because it was feared that their presence in the 
scale might give rise to an evasive attitude 
which would transfer to other items, result- 
ing in an avoidance of the two answer cate- 
gories representing negative feelings towards 
the body. 

The homonym test of body-cathexis (H 
test). The H test consisted of a list of 75 
homonyms, each of which has meanings per- 
taining to the body and meanings not related 
to the body. A substantial proportion of the 
words have meanings pertaining to pain, dis- 
ease, or bodily injury. —Twenty-five neutral or 
nonbody words were interspersed with the 
homonyms for purposes of disguise. This list 
was presented to the testees orally, the homo- 
nyms being read at the rate of one every five 
seconds, with instructions to the subjects to re- 
spond by writing down the first word that 
occurred to them. A score for each individual 
was obtained by totaling responses to bodily 
meanings. It was employed here to provide 
an independent measure of anxiety-related BC. 
This test has been fully described elsewhere, 
and some tentative evidence that it is related 
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to anxiety has been offered [5, 6]. 

Procedure. The H test and the BC-SC 
Scale were administered in a group situation 
to 70 college males and 56 college females. 
The BC-SC Scale and the Maslow Test of 
Psychological Security-Insecurity [3] were 
subsequently administered to an additional 
group of 47 cullege men and women. 

A study of the patterns of responses of in- 
dividuals to the BC-SC Scale suggested that 
response sets were operating for some individu- 
als [1, 2]. In order that split-half reliability 
coeficients for the BC and SC scores, as well 
as intercorrelations between these scores, might 
not be inflated by the artifact of response sets, 
subjects falling in any of the following arbi- 
trary classes were not included in computa- 
tions: (a) a frequency 5 32 in category 4; 
(6) a frequency > 28 in category 5; and (c) 
a frequency > 24 in category 5, when ac- 
companied by less than 2 responses in cate- 
gories 1 and 2 combined. As a result, the 70 
male subjects were reduced to 45, and the 56 
females to 43. It should be emphasized that 
this selection of subjects lowers the correlation 
coefficients obtained between parts of the BC- 
SC Scale, and reduces the split-half reliabili- 
ties of the various subscores. 


Results 


Statistics pertaining to the BC-SC Scale and 
the homonym test. A single score for each in- 
dividual was obtained on the H test, consist- 
ing of the total number of body responses to 


Table 3 
Means, Standard Deviations, and Reliabilities of 
the BC-SC Scale and the Homonym Test 
(N = 45 males; 43 females.) 











Test Mean SD _ Reliability* 
Homonym test 

Males 22.00 6.04 63 

Females 21.14 5.70 -66 
Body-Cathexis 

Males 3.43 337 .78 

Females 3.46 401 83 
Self-Cathexis 

Males 3.43 393 88 

Females 3.35 -510 92 
Anxiety indicator 

Males 3.09 524 -72 

Females 3.05 625 73 





* Corrected by the Spearman-Brown formula. 
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the 75 homonyms. Three types of scores were 


obtained on the BC-SC Scale. These were: 


1. Total BC, obtained by summing the ratings for 
each individual on the 46 body items and dividing 
by 46. 

2. Total SC, obtained by summing the ratings for 
each individual on the 55 self items 
by 55. 


ind dividing 


3. An anxiety-indicator score, obtained by sum- 
ming the ratings for each male individual on the 
11 BC-Scale items most negatively cathected by the 
group of facial complexion, nose, energy 
level, body build, profile, height, chest, teeth, sex 
activities, posture, and weight. These sums were di- 
vided by 11. A similar score, based on the 11 items 
most negatively cathected by females, was also ob- 
tained. 


males: 


Split-half reliability coefficients were ob- 
tained for all of the above scores. These are 
given in Table 3. Reliability coefficients for 
the homonym test are about .15 lower than 
those obtained in previous studies, but are still 
satisfactory. Reliabilities for the various BC- 
SC scores are moderately high; they may be 
regarded as more impressive when it is re- 
called that subjects displaying the most con- 
sistency were removed from the sample. 

No important differences between means of 


the various scores for the two sexes were ob- 
tained. 


Table 4 


Intercorrelations between BC-SC Scores, the Homo- 
nym Test, and the Maslow Test 








(N = 45 males, 43 females; except for the Maslow 
test, for which N — 46 males and females.) 
. Body- Self- Anxiety 
Test : . 


Cathexis Cathexis Indicator 





Homonym test 





Males —.18 -.15 -.37* 

Females —.41** -.23 -.40** 
Maslow test —.37** —.52** -41** 
Self-Cathexis 

Males .58** 

Females .66** 

* Significant at the .05 level. Be 


** Significant at the .01 level. 


Relationship between body-cathexis and self- 
cathexis. Intercorrelations between total BC 
scores and total SC scores are shown in Table 
4. The r for men is .58, and for women, .66, 
suggesting that individuals have a moderate 
tendency to cathect their body to the same de- 
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gree and in the same direction that they cathect 
their self; that is, the two kinds of cathexis 
covary. 


Relationships between body-cathexis and the 
homonym test. An examination of Table 4 
reveals no significant correlations between the 
H test and BC, for the 45 males, or between 
the H test and SC. There was, however, an 
r of —.37 between the H test and the anxiety- 
indicator score which, although low, was sig- 
nificant at the .02 level. For the 43 females, 
on the other hand, correlations significant be- 
yond the .01 level were obtained between H- 
test scores and BC (r = —.41), and H-test 
scores and the anxiety-indicator score (r = 
—.40). Correlations between homonym scores 
and SC were not significant. In general, then, 
there is a low but significant relationship be- 
tween BC as measured by the scale and anxi- 
ety-related BC as measured by the H test. 


A concrete case may perhaps serve to indi- 
cate more specifically the manner in which the 
BC Scale and the H test concern anxiety. 


A woman with an extremely high H-test score 
and an extremely low BC score responded to the 
test items in the following way: 

1. Items on the BC Scaie rated in category 1 
(Have strong feelings and wish change could some- 
how be made) were: facial complexion, appetite, 
hands, distribution of body hair, nose, fingers, waist, 
energy level, ears, body build, skin texture, knees, 
and weight. Items rated category 2 (Don’t like, but 
can put up with) were: hips, sleep, sex activities, 
and posture. None of the 46 body items were rated 
in category 5 (Consider myself fortunate). 

2. On the homonym test, responses to meanings 
pertaining to the body, body processes, or pain and 
disease are shown below, preceded by the homonym 
stimulus word in italics: acid-sour, arch-bend, back- 
broken, bare-ugly, condition-sick, crisis-sick, en- 
larged-grown, extract-tooth, function-stomach, gag- 
whiskey, gall-bile sac, gas-dying, glassy-dead, pa- 
tient-doctor, rash-heat, red-hands, scarlet-disease, 
side-hurt, sling-broken arm, stain-blood, stiff-corpse, 
strip-New Orleans, system-biology, tablet-sleeping 
pill, tan-Daytona Beach, tape-sprained ankle, tender- 
skin, trunk-body, and waist-starve. 

These item responses give some idea of the im- 
portance of the body to this woman and reveal her 
anxiety concerning it. A consideration of the diverse 
nature of the processes involved in the BC Scale 
and the H test as revealed by these items lends sig- 
nificance to the correlation obtained between these 
two tests. 


Sex differences in degree of cathexis. It was 
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found that fe.»-'es cathect their bodies, irre- 
spective of direction, more highly than do 
males, in that they do not assign as many 3’s 
to body items (3 — Have no particular feelings 
one way or the other). The mean number of 
3’s for all of the 46 body items was 10.76 for 
men, and 7.86 for women. This difference of 
2.90 yielded a critical ratio of 1.92, which ap- 
proached significance at the .05 level. Con- 
sistent with this datum is the greater variabili- 
ty of BC scores among women, as previously 
shown in Table 3, although this difference in 
sigmas is not significant. 

Relationships between the Maslow test and 
the BC-SC Scale. The Maslow test was found 
to correlate —.37 with BC, —.41 with the 
anxiety-indicator score, and —.52 with SC. 
These r’s are significant at the .01 level. It 
may be concluded that low cathexis is associa- 
ted with insecurity to some degree. 


Discussion 


One of the most significant results is the . 
demonstration that the body and the self tend 
to be cathected to the same degree. This sup- 
ports the hypothesis that valuation of the body 
and the self tend to be commensurate. 

Since the persons who obtain a high score 
on the H test are regarded as being more 
anxious concerning their bodies than those ob- 
taining a low score, a moderate negative cor- 
relation would be anticipated between BC and 
the H test. This is consistent with the neg- 
ative r actually obtained for women. 


In the case of men, the relative lack of sig- 
nificant relationships between the homonym 
test and the BC-SC Scale cannot be clearly 
explained on the basis of available data. A 
likely but unproved hypothesis is that women 
are more likely than men to develop anxiety 
concerning their bodies, because of the social 
importance of the female body. This hypothesis 
is consistent with the datum that woman 
cathect their bodies more highly than men, ir- 
respective of the direction of cathexis, and with 
the fact that when a BC score based only on 
those body items most frequently arousing neg- 
ative feelings in men was employed, a signifi- 
cant r of —.37 was obtained for men between 
this “anxiety-indicator” score and H-test scores. 

A final support for the interpretation of BC 
as a self-related variable is found in the sig- 
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nificant correlation between BC and insecurity, 
as measured by the Maslow test. 


Summary and Conclusions 


The purpose of the present study was to de- 
velop a method for appraising the feelings of 
an individual towards his body and to ascer- 
tain whether or not variables derived from 
these appraised feelings are significant for per- 
sonality theory. The latter was determined by 
testing the hypotheses stated under 2, 3, and 
4 below. 

A scale for the determination of the degree 
of cathexis towards various aspects of the body 
was designed and administered to groups of 
college males and females, along with a similar 
scale for aspects of the self, a homonym test 
of anxiety-related body-cathexis, and the Mas- 
low Test of Psychological Security-Insecurity. 

The following conclusions may be drawn: 


1. The split-half reliabilities of the two 
parts of the scale were found to be satisfactory: 
.81 for body-cathexis, and .90 for self-cathexis. 

2. The hypothesis that feelings about the 
body are commensurate with feelings about the 
self was supported by significant correlations 
between the two parts of the scale. 

3. The hypothesis that low body-cathexis is 
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associated with anxiety in the form of undue 
autistic concern with pain, disease, or bodily 
injury was upheld by the demonstration of 
significant relationships between low body- 
cathexis as determined by the scale and by the 
homonym test. 

4. The hypothesis that low body-cathexis is 
associated with insecurity was sustained by the 
demonstation of correlation between the form- 
er and the Maslow test. 
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This is the first of two investigations de- 
signed to study differences in the Rorschach 
protocols of patients who remain in therapy 
and those who do not. The present paper is 
concerned with the meanings of the scoring 
categories that differentiate between these 
groups. A subsequent report will be devoted 
to the development and validation of a pattern 
of signs that can be used in the clinic to predict 
duration of therapy. 


In the establishment of valid prognostic 
signs on any projective instrument, the re- 
searcher is beset by numerous difficulties. The 
patient’s behavior in therapy is related not only 
to his character structure but also to such 
interacting sources of variance as the ther- 
apist’s skill, stability in the patient’s working 
hours and his place of residence, and financial 
arrangements. In connection with the interpre- 
tation of the Rorschach protocol, the experi- 
menter must take into account such sources of 
variance as the setting in which the test is ad- 
ministered, the patient’s ego-involvement, and 
the examiner’s character structure [4]. Finally 
the success of the experiment may depend upon 
the accuracy of decisions concerning such as- 
pects of the design as the nature of the sample, 
kinds of controls, and appropriate cutting 
points in duration of therapy for identifying 
the different groups. Negative results are in- 
determinate, while positive results raise more 
questions concerning their theoretical signifi- 
cance than they answer. 


In view of the bewildering complexity of 


1From the Veterans Administration Regional Of- 
fice, Detroit, Michigan. 


variables, it is not surprising that there are 
very few studies of prognosis in therapeutic or 
other situations. However, an increasing num- 
ber of investigations are being motivated by the 
fact that clinicians stake their professional rep- 
utations upon their abilities to make even more 
complex analyses than those of the present 
study. For example, reports may contain pre- 
dictions of the patients’ relationships to the 
therapists or warnings of the probable dangers 
of depth therapy. While the interpretations 
are sometimes incorrect, many psychologists 
can cite instances of predictions of behavior 
that were borne out in great detail, far beyond 
chance, by subsequent events. It is hoped that 
investigations such as the present one will con- 
tribute to an understanding of the processes 
that are involved in the development of these 
accurate predictions. 


Subjects 


Setting. Subjects were selected from among 
patients at the Veterans Administration Men- 
tal Hygiene Clinic, Detroit, Michigan. The 
work of this clinic is performed by five teams, 
each consisting of a psychiatrist, psychologist, 
social worker, and two or three trainees in 
clinical psychology. To each team are assigned 
all patients who register on a particular day 
of the week. Since there is no policy of schedul- 
ing any type of problem for registration on a 
particular day, various pathologies are ran- 
domized among the different teams. A tabula- 
tion of the incidence of different syndromes in 
the subjects of the present study revealed no 
significant differences among the teams. 

After the patient registers, he is first inter- 
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viewed by the social worker, who notes his 
complaint and source of referral, takes a case 
history, and writes a report attempting to for- 
mulate his dynamics. Then the psychiatrist 
conducts a diagnostic interview. Following pre- 
liminary discussion by the team, the case may 
be referred to the psychologist for diagnostic 
evaluation. After this procedure, the team holds 
a planning conference to review the data and 
decide upon final recommendations. When they 
decide upon therapy, the patient may be re- 
ferred to either a psychiatrist, psychologist, or 
social worker. 

General criteria. For purposes of simplify- 
ing the analysis of data, a number of criteria 
were utilized in the selection of the initial 
pools of subjects. ‘The age range was restricted 
by eliminating veterans of the first World 
War. Only males were used. Finally, cases of 
organic brain damage and disoriented psychot- 
ics were rejected in order to maximize co- 
operation in the administration of tests and 
insure the possibility that all subjects could 
have profited from therapy. 

Criteria for selection of groups. This investi- 
gation involved the comparisons of the proto- 
cols of three groups. All members of the first 
group were receiving psychotherapy at the 
time data were collected and had been in treat- 
ment continuously for at least six months. Be- 
cause visits to the clinic by different patients 
varied between one and three times per week, 
the number of sessions in this group ranged 
between 27 and 305; the mean is 121. 

Group II consisted of subjects who discon- 
tinued therapy prior to the sixth session against 
the therapist’s advice. Care was taken not to 
include individuals who had to terminate treat- 
ment because of circumstances beyond their 
control, such as change in working hours or of 
residence. The number of therapeutic appoint- 
ments ranged between one and five, with a 
mean of 2.7. In order to control for the skill 
of the therapist, the design required that each 
contribute an equal number of patients to the 
first two groups. Sixty-six cases were found 
who conformed to the general criteria and 
could be paired in terms of their common ther- 
apists. Thus 33 were assigned to each group. 

Like the other subjects, members of Group 
III were processed by their teams and advised 
to undertake psychotherapy. Unlike the others, 
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they refused treatment. Of the cases in the 
files who met the criteria, 33 were chosen at 
random, care being taken not to include those 
who declined therapy because of situational 
factors beyond their control. 

Therapists. Of necessity, the procedure of 
selecting patients simultaneously determined 
the population of therapists. It may help in 
the interpretation of results to discuss some of 
the characteristics of this population. There 
were ten therapists in all, four psychiatrists, 
four clinical psychologists, and two social 
workers. In the three professional groups, there 
were considerable variations in the amounts of 
experience with adult neurotics and psychotics. 
The psychiatrists varied between one and five 
years of practice beyond the residency. Among 
the psychologists, the least experienced had re- 
ceived a full year of supervised therapy beyond 
the completion of the doctoral degree ; the most 
experienced had spent half of her twelve years 
of clinical work in therapeutic practice. The 
two social workers had two to five years of 
practice in psychotherapy beyond their formal 
training. 

In the Detroit clinic, cases are presented 
regularly in staff conferences conducted by 
psychiatric consultants, who are all psycho- 
analysts. The considerable influence of these 
consultants is manifested by the psychoanalyt- 











Table 1 
Characteristics of Population of Patients 
IL. 
I. Five Ill. 
Six months sessions Refused 

Variable orlonger orless therapy 
N 33 33 33 
Mean age 31 28 30 
Education: mean grade 10.8 10.5 9.4 
No. of therapists 10 10 
White 31 30 24 
Negro 2 3 9 
Referred by medical clinic 20 21 22 
Referred by vocational 

rehabilitation 1 3 a 
Self-referred 12 9 7 
Diagnosed neurotic 27 22 18 
Diagnosed schizophrenic 

reaction + g 8 
Diagnoses deferred 2 3 7 
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Table 2 
Differences in Absolute Scores of Groups 











Rorschach Mean of Group SD of Group CR 
Score I ll Ill I If Ill I-II I-III II-Ill 

R 31.5 20.2 18.2 17.5 9.7 8.3 3.2¢° 3.9** 1.0 
W 6.6 5.1 6.4 4.9 3.7 3.3 14 2 1.5 
D 20.8 12.7 10.6 9.3 7.5 3.7 3.9%° 6.0** 1.4 
Dd 4.1 2.4 i.l 5.0 2.8 2.0 1.7T 3.29¢ 2.2* 
S 2.1 1.1 1.7 2.3 1.3 1.8 2.2* 3 1.5 
F 16.1 10.9 9.7 8.6 6.6 5.3 2.99 $.69%° 8 
F+ 10.0 7.8 7.9 5.5 4.3 4.6 1.8T 1.9T 1 
M 2.5 1.7 1.7 3.3 1.8 1.8 1.3 1.3 a 
FM 2.7 2.4 2.0 2.3 2.0 1.8 6 1.4 9 
m 9 w } 2 1.5 3 4 2.79° 2.79° 

m--add. m 2.3 5 5 3.4 9 4 3.0°* 3.0** 
k 7 1 1 1.1 3 3 3$.9°° 3.0** ‘in 
K 5 el 3 8 4 6 2.5* 1.2 1.5 
FK 1.6 6 5 8 8 1.1 5.09% 4.6** 4 
Fe 2.3 1.1 1.3 2.9 1.1 1.4 2.2 1.8T .7 
c 3 2 1 39 4 3 1.8T 2.4* 1.0 
CO 4 4 8 P| P| 1.0 oni 2.0* 2.0® 
Sh 5.6 2.5 3.2 5.5 2.1 2.8 $.9°° 2.2° 1.2 
FSh 4.2 2.2 2.8 4.1 2.0 2.4 2.5* 1.7T 1.1 
ShF 1.4 3 4 2.0 5 7 3.19° 2.8°* 7 
FC 1.7 1.4 7 1.6 1.4 9 me 3.19° 2.5* 
CF 1.9 1.1 8 1.9 14 1.2 2.0 2.3* 1.0 
C 3 is el a — 4 3.0** 1.8T 1.4 

SumC 3.9 2.5 1.6 3.1 2.1 1.6 2.1° 3.8** 2.0* 

A 12.5 10.0 9.2 5.0 6.4 3.9 1.7t 3.0** 6 
H 5.6 3.3 3.2 5.0 2.7 3.0 2.3* 2.4* 1 
P 6.3 5.0 6.0 2.3 1.4 2.2 2.8°° 5 2.2* 

No. of Cont. 

Categories 8.1 5.5 5.4 3.3 1.6 2.4 4.0* 3.3%* 2 
An 2.8 1.5 9 2.5 1.6 1.1 2.5° 3.9%* 1.7t 

Sex & Anal. 1.2 | 0 3.1 3 2 2.0* 2.0* 





+ Significant at the 10% level or less. 
* Significant at the 5% level or less. 
** Significant at the 1% level or less. 


ically oriented therapy which is practiced by 
the entire staff. 

The fact that each therapist contributed 
some cases to the first group guaranteed that 
he was able to maintain some relationships 
with patients for at least six months. It might 
be anticipated that some therapists may have 
been excluded from the study because they were 
skilled enough to hold all of their patients and 
therefore could contribute none to the second 
group. Actually, this was not the case. All 
were treating some individuals who, because of 
their primitive defenses or the fear of losing 
their pensions, could probably not have been 
retained in therapy by even the most able of 
practitioners. 


Controls. Table 1 provides a summary of 


variables which, if they were not controlled, 
might have contributed to significant differ- 
ences among the three groups. Of all the dif- 
ferences, only the one involving the proportions 
of Negroes is significant at the 5 per cent level 
of probability. Although the total number of 
Negroes is quite small, the percentage in the 
third group is significantly higher than that of 
the first. However, an independent analysis 
revealed no significant relationships between 
race membership within the groups and differ- 
entiating Rorschach variables. 


Results and Discussion 


In order to maximize reliability, all proto- 
cols were rescored by one individual according 
to Beck’s criteria for location, F+, P, and con- 
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Table 3 
Differences in Percentage Scores of Groups 
Rorschach Mean of Group SD of Group CR 
Score I Il Ill I II Ill I-II I-IlI II-lil 
W 24 30 42 16 20 22 1.3 3.8** 2.4* 
D 65 60 54 15 15 19 1.4 2.6** 1.4 
Dd 10 11 4 9 11 7 4 3.0°* $.2°° 
S 7 5 9 6 6 10 1.3 1.2 2.4* 
F+ 82 89 90 16 15 15 1.8T 2.1* 3 
F 53 54 54 17 18 20 & 2 
M 8 9 9 10 8 9 B 5 ; 
FM 9 12 11 6 8 12 1.7T 9 4 
m 2 1 1 3 2 2 1.6 1.6 
m--add. m 6 2 2 6 4 2 3.1** 3.6°* 
k 2 1 1 4 2 2 1.3 4.9 
K 1 1 2 2 2 3 1.6 1.6 
FK 3 3 2 5 + a inet ) 1.0 
Fe 7 6 7 7 5 7 7 7 
c 1 1 1 2 2 3 fain eS 
Cc’ 1 3 3 3 a 4 2.2® 2.2® 
Sh 17 12 16 10 10 11 2.0* 4 1.6 
FSh 13 11 13 8 10 10 3 bile 8 
ShF + 1 3 5 3 5 3.0** 8 2.0* 
FC 6 6 4 3 6 6 ae 1.7T 1.4 
CF 6 5 4 4 6 6 8 1.6 1.4 
Cc 1 mei 5 2 se 2 2.9%° 1.1 1.5 
Sum C 12 11 9 7 & S 5 1.6 1.0 
8, 9,10 34 36 28 7 14 9 m 2.99* 2.8°%° 
A 43 54 55 12 20 16 2.7** 3.4%° 2 
H 16 16 16 11 13 12 ne ‘ 
P 25 30 37 12 15 17 1.5 3.39°¢ 1.8T 
No. of Cont. 
Categories 29 31 31 10 6 9 1.0 9 
An 9 6 6 7 6 8 1.7+ 1.9t 
Sex & Anal. 3 1 7 3 1 1.4 2.5° 1.4 





+ Significant at the 10% level or less. 
* Significant at the 5% level or less. 
** Significant at the 1% level or less. 


tent, and Klopfer’s criteria for the determi- 
nants. Using the same system, a second psy- 
chologist then independently scored 20 ran- 
domly selected records of the first group and 
15 of the second. The reliabilities of the scor- 
ing categories for the first group ranged from 
.79 to 1.00, with a mean of .95. For Group II, 
the correlations varied between .41 and 1.00, 
and the mean is .87. Only one coefficient was 
below .80. 

Distributions of the frequencies of both ab- 
solute scores and their percentages were then 
prepared for each of the three experimental 
groups. Means and sigmas were calculated and 
the significances of differences among groups 
tested in terms of critical ratios. Table 2 con- 
tains an analysis of differences among the three 


groups on each of the scoring categories. While 
clinicians do not customarily convert all the 
data into percentage scores before making their 
interpretations, this has been done in the pres- 
ent study in order to determine the differences 
among the groups that remain significant when 
the number of responses is controlled. The data 
are contained in Table 3. 


Motivation for therapy and resistance. One 
interpretation of these data is suggested by 
Calden’s [1] comparison of the Group Ror- 
schach protocols of subjects with high and low 
ego-involvement in the test. The ego-involved 
subjects, like Group I in the present study, 
give many responses and obtain high scores in 
D (which usually has a high correlation with 
R), m, diffusion and shading responses and 
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color. Those low in ego-involvement are sim- 
ilar to Groups II and III in their stereotypy 
as indicated by the large proportion of animal 
responses. In Calden’s opinion, the tendencies 
of the poorly involved subjects to favor the 
easily located animal responses and to avoid 
color, shading, and movement reveal a suppres- 
sive control that bans spontaneity. If this inter- 
pretation is also valid for the subjects of the 
present study who do not remain in therapy, 
it raises the possibility that they may wish to 
avoid changing their behavioral patterns. Such 
a goal might be motivated by diverse factors 
such as satisfaction with their current person- 
alities, fear that change may lead to psychosis, 
or the desire to preserve the symptoms that 
justify their pensions. Regardless of the under- 
lying motives, the protocols of these patients 
suggest that they react to the projective test in 
a constricted and unrevealing manner, and 
later leave therapy as soon as the possibility 
arises that they may become emotionally in- 
volved. 

This explanation is further supported by 
Schachtel’s clinical observations of resistances 
to the Rorschach test. These may take the 
form of a fear of being “found out,” a defiance 
privately phrased as: “You are not going to get 
anywhere with me,” or an apparent listlessness 
that serves as “the cover for an unconscious 
quite active resistance” [7, p. 432]. In his 
efforts to achieve a noncommittal record the 
patient often limits his total productivity as 
well as the human and human movements re- 
sponses. The record generally becomes stereo- 
typed in content because of the high proportion 
of animal and popular responses. In the present 
study, all the scoring categories listed by 
Schachtel except human movement, the trend 
of which conforms to his observations, differen- 
tiate significantly between the first group and 
either the second or third in the predicted di- 
rections. 

Other findings tending to support the inter- 
pretation of resistance are the small number of 
content categories in the second and third 
groups and their paucity of sexual and anal 
references. Finally a type of censorship by 
groups who do not stay in therapy is indicated 
by their large F+ percentages. According to 
Rorschach, a high proportion of F+ is a sign 
that the subjects are “bringing to bear all their 
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attention and faculties of self-criticism . . . 
though the answers are extraordinarily stereo- 
typed, showing a poor range of variation” [7, 
p. 57]. 

In summary, the Rorschach records of the 
poor therapeutic risks are characterized by lim- 
ited productivity, few content categories, ster- 
eotypy, a paucity of references to sexual and 
anal topics, little color, and preferences for 
good form responses. If these scoring categories 
are interpreted in the conventional manner, 
they indicate that these patients are probably 
overly deliberate in therapy, do not talk much, 
tend to stick to “safe” subjects when they do 
talk, and censor their emotional reactions. 

Conscious anxiety. An additional interpreta- 
tion of the differential scoring symbols is sug- 
gested by the types of initial complaints. ‘These 
may be divided into three categories, psycho- 
logical, somatic, and a combination of the two. 
Examples of the psychological complaints are 
phobia, obsession, compulsion, anxiety, amnesia, 
worry, irritabili , nightmare, and depression. 
Among the somatic complaints are gastric 
pains, diarrhea, constipation, hysterical blind- 
ness, headaches, excessive perspiration, anorexia, 
breathlessness, and hives. Table 4 lists the fre- 
quencies of the different types of symptoms in 
the three groups. 











Table 4 
Initial Complaints 
I. II. III. 

Six months Fivesessions Refused 

or longer or less therapy 
Somatic 5 16 13 
Psychological 9 9 9 
Combination 18 8 10 
Undetermined 1 1 





The chi square of 10.6 is significant at the 
5 per cent level of probability. While a ma- 
jority of Group I complain of a combination 
of psychological and somatic symptoms, the 
largest proportions of those in the other groups 
tend to seek help solely for somatic symptoms. 
The differences between the first and second 
groups are significant at the 5 per cent level. 
A probability of 6 per cent is obtained for the 
comparison of the first and third. Since the 
differences between the second and third 
groups could have been obtained by chance, 
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they may be considered homogeneous with re- 
spect to type of complaint. 

Fenichel [2] notes that somatic symptoms 
are alternatives to anxiety as derivatives of 
forbidden impulses. Usually, the more the pa- 
tient complains of somatic symptoms, the less 
concerned he is with the problems that create 
them. From these observations, it was deduced 
that patients who tend to somatize to the ex- 
clusion of psychological problems should mani- 
fest fewer signs of anxiety on their Rorschach 
protocols than others. This tends to be the case. 
Of the indicators of anxiety listed by Klopfer 
[3], the two groups who do not remain in 
therapy have significantly less FK, &, Fc, and 
m than the group that remains in therapy. 
Not significant but in the predicted direction 
is the paucity of K in the records of the soma- 
tizing groups. 


A Comparison of Two Experiments 


Judged by the number of significant differ- 
ences, Group I, consisting of those who stayed 
in therapy at least six months, is very different 
from the subjects who refused therapy or did 
not continue after the fifth interview. On the 
other hand, in terms of the signs of cooperative- 
ness and ability to face anxiety there seems to 
be little difference in the motivations of pa- 
tients in this clinic who see a therapist less 
than six sessions and those who refuse therapy 

utright. This problem of determining an ap- 
propriate cutting point suggests one explana- 
tion of the discrepancy between the present 
results and those of another investigation of 
duration in therapy by Rogers, Knauss, and 
Hammond [5]. These investigators report a 
lack of significant differences between the pro- 
tocols of subjects who stayed in therapy and 
those who left early. In that design, there were 
two groups: one had four or less therapeutic 
sessions and the other had five or more. Rea- 
sons for the choice of this cutting point are not 
presented. It is conceivable that there were no 
significant differences in the motivations for 
therapy or the defenses of those who had four 
therapeutic sessions and those who had five, 
six, seven, or even twenty appointments. This 
problem was avoided in the present experi- 
ment which utilized extreme groups, those with 
five sessions or less and those who stayed in 
therapy at least six months. Other modifica- 
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tions of the design by Rogers, Knauss, and 
Hammond were the controls of factors that 
could reduce the significance of relationships 
between Rorschach signs and duration of ther- 
apy. These controls included sex, source of 
referral, disorientation, dropping of therapy 
because of reasons beyond the control of the 
patient, and therapist’s skill. Only further 
studies of individual variables can determine 
which aspects of the designs of the two investi- 
gations contributed significantly to the differ- 
ential results. 


Summary 


This is a study of the Rorschach protocols 
of three groups: one remained in therapy for 
at least six months; another terminated treat- 
ment in less than six sessions against the thera- 
pist’s advice; and a third refused therapy when 
it was recommended. 

Significant differences between the first and 
the other two groups on R, 4%, H, and 
F+9%, are interpreted as indicating a greater 
motivation for therapy and resultant coopera- 
tiveness on the part of the former. The stereo- 
typy and lack of productivity of the other 
groups seem to indicate resistance to becoming 
involved in the testing and therapeutic proce- 
dures. Significant differences in the scoring 
categories total C, FK, #, Fc, and m are inter- 
preted as revealing a greater awareness of 
anxiety on the part of the first group in con- 
trast to the suppressive reaction of the two 
who do not remain in therapy. 

The present design is compared with that 
of Rogers, Knauss, and Hammond in order to 
account for differences in results. The blind 
empiricism inherent in investigations of the 
prediction of behavior in therapy from projec- 
tive tests is stressed, and an effort is made to 
summarize some of the principal sources of 
variance that require more detailed investiga- 
tion. 


Received January 8, 1953. 
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The Rorschach as a Measure of Real-Life Stress 


David Berger 


Michigan State College? 


Despite the present popularity of the Ror- 
schach test as a clinical tool there is no adequate 
body of validating data to confirm the numer- 
ous assumptions underlying the test’s use. The 
growing concern with this deficiency has begun 
to provide impetus for controlled experimenta- 
tion which should result in a better understand- 
ing of the instrument. 

One of the major problems in the evaluation 
of the test has been to appraise its efficacy in 
measuring anxiety. Much of the work purport- 
ing to treat this problem has been conducted 
under conditions foreign to the clinical applica- 
tion of the test. The list of these efforts in- 
cludes the use of the group Rorschach tech- 
nique as employed by Smith and George [7], 
and the attempts by Williams [8], Eichler [2], 
and Levine, Grassi, and Gerson [4] to employ 
artificial stress to induce anxiety. The results 
obtained in these studies, while suggesting that 
stress influences Rorschach performance, are 
not necessarily pertinent to the usual patient- 
examiner relationship. In a more recent experi- 
ment by Klatskin [3] an acute, real-life, tem- 
porary stress situation was selected to measure 
the influence of anxiety on the test results. In 
contrast to the previous studies her experimen- 
tal setting more closely approximated the test- 
ing situation encountered in clinical practice. 
She was able to substantiate 22 of 26 Rorschach 
indices commonly used in predicting adjust- 
ment, and concluded that the Rorschach was 
sensitive to real-life stress. On the other hand 
the literature contains conflicting evidence sug- 
gesting that the test has questionable validity in 
distinguishing overtly anxious groups from nor- 
mals. For example, Young and Higginbotham 
[10], as well as Wischner, Rotter, and Gill- 
man [9], reported no significant correspond- 
ence between emotional disturbance and certain 


1The writer is now staff psychologist at Fort 
Custer, VA Hospital, Fort Custer, Michigan. 
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“anxiety indicators.” These studies have creat- 
ed a general feeling of scepticism about the test. 
Further investigation appears to be necessary 
to resolve this controversy. 


Problem 


The present study was designed to ascertain 
the influence of a real-life stress on the Ror- 
schach test. It was concerned with the response 
to stress, as well as with the recovery from 
stress over a period of time. Specifically, two 
questions were asked: Is the Rorschach sensi- 
tive to a real-life stress situation, and if so, in 
what respect does the Rorschach reflect the 
stress? 


Procedure 


Sample. ‘Two matched groups each consisting 
of 40 persons were tested and retested six 
weeks later with the Rorschach.” The experi- 
mental group was selected from a population 
of persons on the day of their first admission 
to a tuberculosis hospital or a sanatorium.* Pa- 
tients who were in acute medical stress on ad- 
mission were not seen. A range of 18 through 
46 years was imposed to reduce the influence 
of age factors on Rorschach performance [7 }. 
The control group wzs selected exclusively 
from the sanatorium population. Only patients 
whose hospitalization extended at least six con- 
tinuous months were used. They were matched 
individually with the experimental subjects on 
the basis of age, sex, race, marital status, educa- 
tion, and diagnostic classification [6]. The 
results of the matching are presented in Table 


1. 


The tests were administered and scored ac- 
cording to the method developed by Beck [1]. 


2Other measures were utilized and will 
ported in a subsequent article. 

‘Herman Kiefer Hospital and Wm. Maybury 
Sanatorium are Wayne County tuberculosis facili- 
ties serving the City of Detroit and its environs 


be re- 
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Table 1 


Summated Characteristics of Experimental and 
Control Samples 








Experimental Control 





Population variables sample sample 
Sex 

Male 21 21 

Female 19 19 
Race 

White 38 38 

Negro 2 2 
Marital status 

Married 31 32 

Single 6 6 

Separated 2 2 

Widowed 1 0 
Mean age 31.10 30.98 
Mean education (grade) 10.23 10.30 
Extent of illness 

Minimal findings 4 3 

Moderate findings 26 26 

Far advanced findings 10 11 





Both groups were given the impression that the 
testing procedure was an integral phase of the 
treatment program, but participation on the 
part of the patient was optional. After com- 
pletion of the initial test it was explained to 
each patient that he would be seen again in a 
number of weeks. 


Stress situation. It was assumed that most 
patients entering a tuberculosis hospital per- 
ceive their admission as a threatening experi- 
ence. It seemed reasonable to consider that such 
a situation would generate anxiety and should 
conceivably afford an opportunity to measure 
anxiety in human beings outside the experimen- 
tal laboratory. 


A six-week interval between test and retest 
was used with both groups. It was hoped that 
this interval would allow the newly arrived 
patient ample time to make some adjustment to 
the hospital environment. The expectation was 
that his readjustment would be reflected in the 
change from test to retest. The control group 
was employed to control the questionable relia- 
bility of the test. Because of the relatively 
stable environment of the sanatorium it was 
felt that the interval between tests would not 
contribute any significant variance to the re- 
test performance of the control population. 





Statistical treatment. The Rorschach results 
were handled in terms of the global configura- 
tion of the performance, as well as by analyzing 
the various atomistic changes. In dealing with 
the global Rorschach, two judges were asked 
to select the more anxious record from the two 
records of each experimental subject. The 
atomistic procedure was carried out by the com- 
parison of differences between the test results 
from test to retest in the two groups. The dif- 
ference in scores between test and retest was 
computed for each subject. Each experimental 
subject’s difference score was compared with 
the difference score earned by the matched sub- 
ject in the control group. The distribution of 
differences between difference scores was util- 
ized to yield ¢ values. McNemar [5] has dis- 
cussed and justified this method for treating 
the relative shifts in two groups over a period 
of time. The difference between the shifts in 
the two groups was accepted as a behavioral re- 
sponse to stress. 


‘The atomistic analysis of the Rorschach pro- 
tocols was based on the absolute number in 
each scoring category. The traditional objec- 
tion to a raw-score procedure in Rorschach 
experimentation is that when two populations 
produce deviant response totals, any difference 
in the scoring variables is likely to be a function 
of the differences in the response totals. Many 
experimenters have attempted to satisfy this 
criticism by converting into percentages and 
other statistical derivatives. It is questionable 
whether these corrections are sound or really 
necessary. The view taken in this research was 
that response total is in reality the dependent 
variable, mirroring dynamic changes in person- 
ality as demonstrated in the approach, deter- 
minant, and content scoring factors. The evi- 
dence points to a differential change in the 
scoring variables attending a change in response 
totals. If the various scores were the dependent 
factors that they have ordinarily been conceded 
to be, it should follow that they vary directly 
with changes in response total. The present 
data, in fact, show many instances in which 
an increased total response is accompanied by 
a decrease in certain other scores. It seemed 
more parsimonious to view response total as a 
summary statistic dependent upon the remain- 
der of the scoring profile. 
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Results 


Configurational findings. The problem of 
the reliability of the judgments made on the 
total test performance by the two raters was 
handled by chi square. The two judges were 
in agreement in their evaluation on 33 of 40 
pairs of records, that is, they selected the same 
record as being the more anxious of the two 
records obtained from each experimental sub- 
ject. This result is significantly better than 
chance at the 1 per cent level. 

The validity of the judgments was similarly 
subjected to a chi-square test. One judge made 
35 “correct” judgments, i. e., selected the first 
test, out of 40 judgments, while the second 
judge was able to identify “correctly” 36 of the 
40 pairs of records. The chi square for each 
judge was significantly better than chance at 
the 1 per cent level. 


Atomistic findings. A comparison of the 
shifts of the two samples described from test to 
retest for the various Rorschach scores is sum- 
marized in Table 2. There were statistically 


Table 2 


Comparison of Change from Test to Retest between 
Experimental and Control Groups 











Po @ = 
- co 8 oo 2 ¢ 
; saat acak bled 
sid . ALES ae 
R 7.22% 0.42* 6.80 13.19 .01 
F plus % -2.75 7.42 -10.18 17.74 .001 
# Content 
Categories 1.98 -0.18 2.15 3.10 .001 
T/IR 8.85 -1.36 -7.49 10.33 .001 
AN —3.58 2.05 -5.62 14.91 .05 
H Hd 2.65 0.80 1.85 6.25 N.S. 
W —2.28 1.15 -3.42 4.19 .001 
D 8.88  -0.52 9.40 10.30 .001 
Dd 0.60 0.48 0.12 4.18 N.S. 
M 1.80 -0.02 1.82 3.16 .001 
Sum C 1.59 =1.12 + ee 
Sum Y —1.08 0.49 —1.56 1.52 .001 
Sum V7 —0.14 0.09 -0.22 0.68 .05 
P 2.58  -0.50 3.07 2.18 .001 
AY -0.20 -0.70 0.50 1.97 N.S. 
Card Reject -15t -2t (not calculated) 





Note—Significance was determined by two-tailed test. 
*A positive score means an increase from first to 
second test. 


+ Total difference in number of rejections. 
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significant shifts in 12 of the 16 variables 
assayed. These shifts were presumably the re- 
sult of the anxiety associated with the admuis- 
sion situation. In general the direction of the 
shifts as well as the kind of change noted is 
consistent with the “anxiety indicators’ com- 
monly used in clinical practice (‘lable 2). 
Stress was demonstrated to influence the 
Rorschach in this study by: (a) reducing re- 
sponsivity (R), (4) enhancing reality testing 
(F+9%), (c) decreasing the breadth of inter- 
est (number of content categories), (d) in- 
creasing reaction time (7'/1R), (¢) increasing 
the number of whole comprehensive responses 
(W), (f) decreasing the number of common 
detail responses (D), (g) decreasing the 
amount of inner living and creativity (/), 
(h) decreasing the emotional participation 
with the environment (Sum C), (7) increasing 
dysphoric feelings, and feelings of inferiority 
(Sum Y and Sum /’), (7) increasing stereo- 
typy and evasiveness (4%), (&) reducing the 
ability to think in terms of group standards 
(P), and (/) intensifying the need to reject 
environmental stimulation (rejections). 


Discussion 


The response of the experimental popula- 
tion seems to have been influenced markedly 
by the stress of entering a tuberculosis institu- 
tion. With two exceptions (W and F+%) 
all the shifts in Rorschach performance are 
consistent with the alleged indices of anxiety. 
The present study is at variance with previous 
findings in that stress appeared to facilitate the 
perception of whole responses, and increased 
the need to adhere closer to reality. ‘The Ror- 
schach records of the experimental group in the 
first test were then analyzed to determine the 
type of W response elicited. A large preponder- 
ance was found to be ready-made, easy wholes. 
They probably represent the most elementary 
type of response, involving a minimum of effort 
for the subjects under stress. 

The present findings support the contention 
that the Rorschach test is a useful instrument 
for measuring anxiety in the type of clinical 
situation studied here. The conflicting view 
that the Rorschach has questionable validity for 
measuring anxiety may stem from a different 
experimental emphasis, utilizing artificial lab- 
oratory stress or diagnostically anxious sub- 
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jects. The present study, as well as the one 
reported by Klatskin [3], suggests that real-life 
stress is an effective medium for measuring the 
effect of anxiety on Rorschach performance. It 
seems reasonable to presume that a real-life 
stress condition results in more pervasive dis- 
comfort than the distress aroused by a noxious 
laboratory stimulus. 

The effectiveness of the Rorschach in this 
investigation contributes to the growing reali- 
zation that it is an instrument sensitive to fluc- 
tuations in the life situation of the subject. 
This realization may serve to emphasize the 
pitfalls involved in interpreting the test clini- 
cally without a thorough awareness of the cur- 
rent environmental pressures impinging on the 
individual. 


Summary 


Two matched groups of tuberculous pa- 
tients were tested with the Rorschach and re- 
tested six weeks later. One group was seen 
initially on the day of their admission to a 
tuberculosis treatment facility. The second 
group was seen after they had been hospitalized 
for at least six months. The major hypothesis 
was that the initial admission situation would 
provoke a stress reaction recognizable on the 
Rorschach test. 

Other than for minor discrepancies, the re- 
sults obtained were consistent with anxiety 
signs used in clinical practice. It was also dem- 
onstrated that the Rorschach could be used as 
a measure of total personality adjustment in a 
stress situation. Certain cautions were dis- 
cussed in regard to the need to evaluate the im- 


David Berger 





medediate life situation in using the Rorschach 
in personality analysis. 
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References 


1. Beck, S. J. Rorschach’s test. 1. Basic processes. 
New York: Grune & Stratton, 1944, 

2. Eichler, R. M. Experimental stress and al- 
leged Rorschach indices of anxiety. J. abnorm. 
soc. Psychol., 1951, 46, 344-355. 

3. Klatskin, Ethelyn H. An analysis of the effect 
of the test situation upon the Rorschach record: 
Formal scoring characteristics. J. proj. Tech., 
1952, 16, 193-199. 

4. Levine, K. N., Grassi, J. R., & Gerson, M. J. 
Hypnotically induced mood changes in the 
verbal and graphic Rorschach. A case study. 
Rorschach Res. Exch., 1943, 7, 130-144. 

5. McNemar, Q. Psychological statistics. 
York: Wiley, 1949. 

6. National Tuberculosis Association. Diagnostic 
standards and classification of tuberculosis. 
New York, 1950. 

7. Smith, S., & George, C. E. Rorschach factors 
related to experimental stress. J. consult. Psy- 
chol., 1951, 15, 190-195. 

8. Williams, M. An experimental study of in- 
tellectual control under stress and associated 
Rorschach factors. J. consult. Psychol., 1947, 
11, 20-29. 

9. Wischner, G. J., Rotter, J. B., & Gillman, R. 
D. Projective techniques. In S. W. Bijou 
(Ed.), The psychological program in A.AF. 
Convalescent Hospitals. A.A.F. Aviat. Psy- 
chol. Progr. Res. Rep. No. 15. Washington: 


New 


U. S. Government Printing Office, 1947. Pp. 
144-157. 

10. Young, R. A., & Higginbotham, S. A. Be- 
havior checks on Rorschach method. Amer. J. 
Orthopsychiat., 1942, 12, 87-94. 





Journal of Consulting Psychology 
Vol. 17, No. 5, 1953 
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Basic to the use of the Rorschach technique 
in present-day research is the assumption that 
the psychogram is determined by the personal- 
ity of the subject. In the final analysis the value 
of the Rorschach as a scientific instrument is de- 
pendent upon the validity of the objective in- 
dices derived from the test scores. Recently a 
number of studies have focused attention on 
factors other than the personality of the subject 
which determine his Rorschach psychogram. 
The presence of two major sources of such in- 
fluences has been demonstrated in previously 
published studies. These are the “set” of the 
subject [3, 6, 7, 8] and the stimulus value of 
the examiner [2, 3, 4, 5, 9]. A major implica- 
tion of these studies is that obtained scores on 
the Rorschach determinants cannot be regarded 
as corresponding solely to the various areas of 
the subject’s personality structure and its func- 
tioning. 

In order to investigate further the influence 
of the examiner on the Rorschach psychogram, 
Gibby studied the changes which occurred 
from the free association to the final response 
following the inquiry. 

Let us at this point briefly review the gen- 
eral technique of Rorschach administration. It 
may be considered as being composed of two 
dependent but nevertheless two clearly differ- 
entiated processes. In the first, the free associa- 
tion, the examiner plays a comparatively passive 
role, with the subject being requested to free 
associate to the Rorschach plates as they are 
presented to him. In the second, the inquiry, 
the role of the examiner is much more active, 
and as the plates are re-presented he conducts 
an inquiry designed to “clarify” the previously 


1 From the VA Regional Office, Detroit, Michigan. 
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given free associations of the subject. The con- 
clusions of the previously mentioned research 
on the Rorschach inquiry have raised important 
questions which bear on the relationship of the 
free association to the inquiry. These ultimate- 
ly have a bearing upon the presumed validity 
of the entire Rorschach technique. It is the 
purpose of the present study to investigate cer- 
tain aspects of the relationships that exist be- 
tween the Rorschach free association and in- 
quiry. 

There are three major areas of interest in 
the present research. These are: (a) the simi- 
larity of the free-association record to that fol- 
lowing the inquiry, (4) the comparative effect 
of the stimulus value of the examiner on the 
free association and the inquiry, and (c) the 
personality characteristics of the individuals 
who show the greatest and least amount of 
change from free association to inquiry. 

It is felt that the questions asked in connec- 
tion with these major areas raise issues crucial 
to the utilization of the Rorschach technique in 
contemporary research. For example, does the 
present method of scoring a Rorschach proto- 
col, based as it is upon the combined free as- 
sociation and inquiry, yield the most unbiased 
picture of the subject’s personality? Again, to 
what extent are the Rorschach scores and in- 
dices, used in many studies to test various hy- 
potheses, contaminated by factors characteristic 
not of the subject’s personality but rather more 
of the examiner’s? It is hoped that the present 
study will enable the Rorschach technique to 
be more effectively utilized in assessing the 
personality of the subject, and equally im- 
portant, lead to a reconsideration of methods 
of analysis of Rorschach data in research. 

The study will be concerned with the follow- 
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ing specific questions : 

1. Are there significant differences between 
the Rorschach determinants produced in the 
free association and those following the in- 
quiry? 

2. Do clinicians differ among themselves in 
the Rorschach determinants produced in the 
free association ? 

3. Is the effect of the stimulus value of the 
clinician on the Rorschach determinants pro- 
duced during the free association greater or 
less than that on the inquiry? 

4. Are there any differences in free-associa- 
tion Rorschach determinants between those in- 
dividuals who change the most and those who 
change the least from free association to in- 
quiry? 

Experimental Design 


In order to investigate these hypotheses, an 
experimental group of 24( patients at the 
Veterans Administration Mental Hygiene 
Clinic, Detroit, Michigan was formed. Each 
of these subjects was assigned to a Rorschach 
examiner depending upon the day on which 
he first came to the clinic. No other basis of 
assignment was utilized. Since the clinic has 
no policy of scheduling any particular type of 
patient on any certain day, it was felt that 
this procedure could be regarded as a random 
assignment of subjects to an examiner. Twelve 
examiners were employed, each testing twenty 
subjects. All examiners had received formal 
training and supervised experience in the ad- 
ministration of the Rorschach, and it was felt 
that from this point of view all were equally 
proficient. They were all either Veterans Ad- 
ministration clinical psychology staff members 
or advanced trainees assigned to the Detroit 
Mental Hygiene Clinic. The Rorschachs were 
given routinely, the inquiry being structured 
by the examiner in his usual manner. None of 
the examiners had any knowledge or awareness 
that the present study was to be conducted. 

The Rorschach determinants investigated 
were: F, M, FC, CF, C, ¥Y, YF, Y, and V. 
Beck’s [1] scoring techniques were in general 
employed for scoring these determinants. The 
free-association responses were first scored for 
each record. Next, the combined free-associa- 
tion and inquiry responses were scored. Each 
response was thus scored twice, each scoring 
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being done independently. Reliability of the 
scoring was then determined. For this purpose 
27 records were randomly selected, and they 
were then rescored by a second person who had 
been previously trained in the scoring tech- 
niques utilized in the study. Criteria for scor- 
ing of responses were determined in advance. 
For example, it was decided that all responses 
such as “humans pointing” should be scored 
as M. 


In order to control the variability possibly 
introduced by R, the number of responses for 
each determinant in the free-association scoring 
of each record was converted to a percentage. 
This was done by dividing the number of re- 
sponses for each of the determinants by the 
total number of responses. The same procedure 
was followed for the inquiry scorings. Thus 
two percentages were calculated for each de- 
terminant in each record — the first being the 
percentage of the determinant in the free as- 
sociation and the second being the percentage 
of that determinant following the inquiry. In 
order to treat the data more adequately sta- 
tistically, these were then translated into arc- 
sine units. It was thus possible to analyze the 
data in terms of both the absolute and the per- 
centage scores. The appropriate statistical 
manipulations were then performed in light of 
the particular hypothesis to be tested. 


Results 


The first concern was reliability of scoring. 
Pearson product-moment correlations between 
two scorers were computed for each deter- 


Table | 


Comparison of Means of Rorschach Determinants 
in Free Association and Inquiry t 














Absolute score Are-sine r Between 
Determi- Mean free assn. 
nant diff. CR CR and inquiry 
F —4.79 17.10** 26.2** 97 
M -30 4.29** 7.0** 97 
FY 2.14 13.37** 21.4** 21 
YF 29 9.67** 7.39%° 54 
Y 02 2.00** 1.7 71 
FC 96 12.00** 14.8** 58 
CF -90 11.25** 13.1** -63 
Cc alg OE Beas Bag i 92 
V 19 4.75** 5.19%° 61 
R a — - 1.00 
+N = 240. 


** Significant beyond the 1% level. 
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minant. ‘This was done for both free associa- 
tion and inquiry. The mean reliability for 
free-association scoring of the experimental de- 
terminants was .91, and for inquiry .92. 

In order to test the first hypothesis in re- 
gard to differences between free association 
and inquiry, critical ratios were calculated on 
both the difference in arc-sines and the differ- 
ence in absolute scores for each determinant 
from free association to inquiry. These data 
are presented in Table 1. It may be sum- 
marized from this table that: 


1. The following Rorschach determinants 
change significantly from free association to the 
inquiry: FY, YF, FC, CF, F, M, and V. No 
significant change occurs on Y or C. These 
changes occur when the determinants are com- 
pared on both percentage and absolute scores. 

2. The determinants may be differentially 
ordered as to the amount of change shown 
from free association to inquiry. F shows the 
greatest change, followed by FY. Next come 
FC and CF, followed in order by M, YF, V, 
and Y. F decreases from free association to 
inquiry while all the other determinants show 
an increase. 

3. The correlations between the determi- 
nants from free association to inquiry also may 
be differentially ordered. Those showing a 
high degree of relationship are F, M, and C. 
Those showing a moderate relationship are Y, 
CF, V, FC, and YF. There is comparatively 
very little correlation between the number of 
FY responses on the free association and those 
following inquiry. 

In order to explore the second and third 
hypotheses in regard to the variance attribu- 
table to the stimulus value of the examiner, 
an analysis of variance was done between the 
distributions of arc-sines for each of the Ror- 
schach determinants on the free association. An 
earlier study [5] reported the differences be- 
tween examiners following inquiry. The re- 
sults of these analyses are: 


1. On the free association there are no sig- 
nificant differences between examiners for any 
of the Rorschach determinants. 

2. On the inquiry there are significant dif- 
ferences beyond the 5% level in the cases of 
the FY and Y determinants. 

A prior study of Gibby [4] showed that ex- 


aminers differed significantly among themselves 
in changes from free association to inquiry. 
That there is no difference between examiners 
on the free association and that there is such 
a difference on the inquiry is demonstrated in 
the present study. Therefore, the free associa- 
tion appears to be free of examiner influence 
and whatever examiner influence occurs on the 
Rorschach is attributable to the inquiry. 

The third question was concerned with the 
personality characteristics of those individuals 
who changed the most from free association to 
inquiry as opposed to those who changed the 
least. In order to investigate this, distributions 
were first made of the changes by subjects in 
F from free association to inquiry in arc-sine 
units. Changes in F reflect the summation of 
the changes in all other variables since the 
change in every instance was from F in the 
free association to another determinant in the 
inquiry. The data were then analyzed in two 
ways: (a) with regard to examiner, and (+) 
without regard to the examiner. 

It has been shown that examiners differ 
among themselves in the amount of change 
produced from free association to inquiry. It 
is possible that those examiners producing the 
least change had within their group of sub- 
jects individuals who were capable of change, 
but due to the influence of the examiner 
showed comparatively little change. Therefore 
the six examiners producing the greatest 
amount of change were utilized. For each ex- 
aminer the five individuals showing the great- 
est amount of change and the five individuals 
showing the least amount of change in F from 
free association to inquiry were selected and 
combined to form two groups. The critical 
ratios between these were calculated for each 
of the Rorschach determinants in the free as- 
sociation. It was found that those individuals 
who changed the most from free association to 
inquiry showed a significantly higher number 
of F and a significantly lower number of M 
and FC responses in the free association. 

In addition a new sample was chosen with- 
out respect to examiner. The 40 individuals 
showing the most change were compared with 
the 40 showing the least change. Here also 
those individuals changing the most from free 
association to inquiry showed a significantly 
higher number of F and a significantly lower 
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number of M and FC responses in the free 
association. These data are presented in Table 


2. 
Table 2 


Comparison of Free-Association Determinants of 
Groups Changing Most and Least from Free 
Association to Inquiry 








Critical ratio ¢ 





Examiner aminer 
Variable uncontrolled controlled 
(N = 80) (N = 60) 
F 2.5° 5.6* 
M 4.0* 4.7* 
FY 6 5 
YF 1.8 1.0 
FC 2.6* 3.1* 
CF 1.1 1.6 
C 5 1.9 
V 3 1.2 





* Significant beyond the 5% level. 
+ Critical ratios are based upon arc-sine differ- 
ences. 


Discussion 


Like other psychological techniques the Ror- 
schach is utilized in a dual capacity. In one it 
plays the role of a clinical instrument, being 
used to explore the various aspects of the per- 
sonality of an individual patient. Here the 
contribution of the technique may be con- 
sidered as being directly dependent upon the 
skill of the clinician, and the administration 
and interpretation of the Rorschach become 
in practice highly subjective processes. The 
inquiry itself varies both with the examiner 
and with the patient and may assume, for ex- 
ample, a directive or nondirective character de- 
pending upon the problem which the clinician 
is called upon to solve. Many clinicians say 
when this possibility is discussed with them, 
“Yes, I pushed hard here for shading (or 
movement or color) but I recognized this and 
took it into account when I interpreted the 
record.” This is perhaps as it should be since 
the clinician, in order to deal with his exceed- 
ingly complex referral problems, must call up- 
on all of his individual skills and clinical in- 
sights. Although it is beyond the scope of the 
present study, the question might well be raised 
as to how many of these insights are valid. 
How many rest upon what may be an unevalu- 
ated structure based upon personal experience 
rather than upon adequately investigated facts? 
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In its second role the Rorschach is becoming 
more extensively used as an experimental in- 
strument, being applied to a wider range of 
problems. Here it is not the subjective im- 
pressions obtained by the clinicians which have 
been utilized so much as the scores which are 
recorded for the various Rorschach location, 
determinant, and content variables. It is in 
this aspect of the utilization of the Rorschach 
that we are most interested at the present time. 


Since the research applications of the Ror- 
schach deal essentially with scores, then we 
must of necessity be concerned with how these 
scores are obtained. The present study demon- 
strates that the examiner introduces a signifi- 
cant variance into the obtained scores which, 
as one illustration of the possible distortion, 
might tend to make nosological groups con- 
verge in their mean final Rorschach scores 
on various determinants. It may be assumed 
that experimental results containing variance 
introduced by the examiner would affect the 
theoretical constructs based upon the evidence. 
For example, studies based upon the Rorschach 
data collected by a single examiner would be 
contaminated by the particular personality 
characteristics of that examiner. It has been 
shown that examiners differ among themselves 
in regard to their effect upon the subjects. 
Studies based upon the Rorschach data collect- 
ed by several examiners might be suspect for 
the same reason. In addition there is the 
further complicating factor of the differential 
reactions of individuals to the examiners. All 
these must be controlled before the Rorschach 
data can be most properly utilized in research. 


The present study has demonstrated that ex- 
aminer influence occurs on the Rorschach dur- 
ing the inquiry, and that its effect on the free 
association is minimal. It is therefore felt that 
attention should be given to the development 
of techniques designed to reduce the possibility 
of examiner influence. One such technique 
might be to give the subject the usual instruc- 
tions prior to the administration of the test, 
but in addition to ask at that time that he give 
also the location and determinants. For ex- 
ample, he could be given the following instruc- 
tions: “Tell me where you see it, and what 
suggests it to you.” It is felt that the merits 
of this technique warrant consideration and ex- 
perimental exploration. 
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It is not the purpose of this discussion to 
belittle the importance of the inquiry insofar 
as the results are utilized by the clinician in 
his handling of the problems presented by the 
individual patient. The verbalizations and con- 
tent produced are often clinically rich in that 
they offer clues to the underlying dynamic 
processes with which the clinician is concerned. 
Rather, it is the fact that the complexities of 
the interaction of the subject and the examiner 
during the inquiry result in scores which are 
not only properties of the personality of the 
subject but also those of the examiner. Be- 
yond the implications of this being a con- 
taminatory factor in research applications, the 
findings have additional implications for the 
clinical interpretation of the Rorschach. The 
inquiry may be viewed not only as an interac- 
tion process between the subject and the ex- 
aminer, but as a situation in which a second 
distinct perceptual process is experienced by 
the subject during the re-presentation of the 
Rorschach plates. This might be considered in 
itself as an additional unique perceptual ex- 
perience. Systematic studies of the changes 
which occur on this re-presentation would be 
valuable since the changes from free associa- 
tion to inquiry within a given record might 
have considerable clinical significance. The 
findings of the present study offer some clues 
as to this process of change. 


It was found that those individuals who 
changed the least from free association to final 
response following inquiry had a significantly 
higher amount of M and FC and lower 
number of F responses in their free-association 
records than did those who changed the most. 
This held true regardless of whether or not 
the examiner influence was controlled. The 
higher M suggests that those individuals with 
the least changes are possibly more comfortable 
in the interpersonal situation, relating more 
adequately to the examiner. They are less 
ready to interpret the situation as one of threat 
and consequently change relatively little in the 
shading determinants. Shading on the inquiry 
in the previous study [4] was shown to be 
related to the overt hostility of the examiner. 
The higher FC may be presumed to indicate 
that they relate better to external environ- 
mental situations and that their emotional re- 
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actions are more stable. The higher M and 
FC scores suggest that those individuals who 
in the Rorschach test situation change the 
least from free association to inquiry may be 
characterized as more rich and mature person- 
alities. They possess a comparatively higher 
degree of psychic energy leading to a more 
complete and fuller initial response to the Ror- 
schach blots. This is again suggested by the 
findings in regard to F. The persons changing 
the most had a significantly higher number of 
F responses on free association than did those 
who changed the least, being more constricted 
and showing greater affective suppression. 
Finally, there is another crucial aspect of the 
relationship of the free association to the in- 
quiry which has not been investigated. The 
question now arises as to their relative validity 
as measures of the personality characteristics 
of the individual. Which gives the more ac- 
curate picture of the person? Additional 
studies are planned to investigate this area. 


Summary 


1. Three areas of the relationship of the 
Rorschach free association and inquiry were in- 
vestigated: (a) their similarity, (4) the com- 
parative effect of the stimulus value of the ex- 
aminer on each, and (c) the relationship of the 
personality characteristics of the subject to 
changes from free association to inquiry. 

2. The subjects were 240 patients at the 
Detroit Mental Hygiene Clinic tested by 12 
examiners, each testing 20 patients. 

3. It was concluded that (a) the free-as- 
sociation record significantly differs from that 
of the inquiry, (4) the free association is rela- 
tively free of examiner influence and virtually 
all influences which occur are attributable to 
the inquiry, (c) the personality characteristics 
of those individuals changing the most differ 
significantly from those changing the least. 

4. The implications of the findings for both 
the clinical and research utilization of the 
Rorschach were discussed. Of particular im- 
portance was the need for re-evaluation of past 
studies in light of the differential examiner in- 
fluences on the inquiry. The need for studies 
of the relative validity of the free association 
and inquiry was stressed. 


Received January 12, 1953. 
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The present investigation has for its pur- 
pose the analysis of the Rorschach records of 
45 cases of involutional melancholia. Relative- 
ly little has been published about the Rorschach 
patterns for this type of mental abnormality. 
What is available is about depressive states 
generally, without much attempt to differen- 
tiate a specific pattern for involutionals. The 
evidence of the present study indicates that the 
typical involutional in this group is quite dis- 
tinct from the individual presented in the Ror- 
schach literature on depressed states under 
which involutional melancholia has been hither- 
to rather indiscriminately subsumed. These 
data then should represent an aid in a more 
adequate differential diagnosis. 

The involutional psychosis is characterized 
by depressions occurring in middle and later 
life without evidence of any organically deter- 
mined intellectual defects. The symptoms in- 
clude agitation, uneasiness, unreality feelings, 
nihilistic delusions, anxiety, depression, insom- 
nia, self-condemnation, and hypochondriacai 
elements. There is no history of previous at- 
tacks [5]. There are two types of involutional 
melancholia, the paranoid type in which there 
are delusions of persecution without a history 
of paranoid behavior, and the depressive type 
with typical signs of profound melancholia. 
While genetic and endocrine factors, particu- 
larly the latter, are important etiological fac- 
tors, the social factors must not be neglected. 
Among the latter the factors of status and 
personal adequacy are of particular importance 
[3]. In involutional melancholia the self-con- 
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cept is thought to undergo radical changes as 
a result of increasing age, menopausal changes, 
appearance changes, changes in energy and am- 
bition, family disintegration, sickness, especially 
in relation to death, and a concern with the 
next life. For these people, the future is said to 
be essentially threatening and negative rather 
than stimulating and challenging. 

The Rorschach data collated from previous 
studies leave something to be desired. As pre- 
viously indicated most of the studies, specifi- 
cally those of Rorschach [10], Guirdham [4], 
Varvel [11], Beck [1], Bochner and Halpern 
[2], Klopfer and Kelley [8], give factual in- 
formation with regard to the general category 
of depressives but not adequately for involu- 
tionals. Rapaport [9], Johnson and Sherman 
[6], and particularly Kendig and Vernier [7] 
deal specifically with the involutional’s re- 
sponse to the Rorschach. Of these studies that 
by Kendig and Vernier is easily the most sys- 
tematic, carefully designed, and diagnostically 
useful that has appeared to date. In general 
there is little system in the way the facts are 
reported, in what is reported, and how the 
findings are worded. Almost all the investiga- 
tors present their findings in descriptive and 
relative terms. Their data are virtually un- 
amenable to exact statistical evaluation, much 
less cross-validation. An attempt will be made 
however to summarize briefly the facts that 
are available from these studies. 


Rorschach [10] himself does not give the 
number of cases, Guirdham [4] has 161 de- 
pressives and 17 agitated depressives, Varvel 
[11] has 34 depressives and 14 agitated depres- 
sives, Beck [1], Bochner and Halpern [2], 
Klopfer and Kelley [8], and Johnson and 
Sherman [6] do not give the number of cases 
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‘upon which their generalizations are based. 
Rapaport [9] used 7 cases, and Kendig and 
Vernier [7] so far have provided data on 25 
depressives and 25 paranoid involutionals. 
With regard to the number of responses, 
three of these studies [2, 8, 11] give no re- 
sults, the remainder [1, 4, 6, 10] with one 
possible exception [9] indicate that the Ror- 
schach responsiveness is diminished. Reaction 
time of these subjects is unknown from three 
studies [4, 9, 11], whereas the remainder indi- 
cate that it is prolonged without being much 
more specific. Bochner and Halpern [2] and 
Klopfer and Kelley [8] indicate that it will 
generally be sixty seconds or longer. In general 
one can say that all the studies are in substan- 
tial agreement that the F% is considerably 
increased over what is normally expected. In 
several instances F% is over 80. The number 
of M responses again finds rather general 
agreement among the investigators in that there 
is a reduced production in contrast with the 
normal. M is either absent or very low in pa- 
tients of this type, although some exceptions 
are found [6, 8, 10]. All the studies likewise 
generally agree that the C response on the 
Rorschach is markedly reduced or absent. Such 
phrases as “few or none,” and “essential ab- 
sence of C,” characterize the findings. Two 
studies [2, 8] speak of an increased C’ in 
place of the more usual C scores. The four 
studies that indicate any findings about light 
and shading responses show that they are us- 
ually few in relztion to what might normally 
be expected [1, 2, 4,11]. The W factor in the 
test is generally decreased for this type of pa- 
tient [1, 2, 6, 8, 11], although at least four 
studies suggest no decrease or an actual increase 
of W [4, 8, 9, 10]. This increase in W may 
however be for the neurotic type of depression 
rather than for the psychotic type. The find- 
ings with respect to the relations between H 
and Hd are unanimous, where present, in find- 
ing an increase of Hd over H [1, 4, 8, 10, 11]. 
It is also generally agreed by these investiga- 
tors that the 4% is increased [1, 2, 4, 8, 10, 
11]. Two studies find a decrease in 4%, but 
these two are specifically for involutional pa- 
tients [6, 9]. Three studies report on the orig- 
inal response [4, 8, 10]. In all instances they 
are low or absent, and if present they tend to 
be bizarre [6]. The findings with regard to 
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the popular responses are inconsistent. Six of 
the eight studies report such data, of which two 
[4, 8] suggest an increase and three [6, 9, 
11] suggest a decrease. 

The preliminary findings of the Kendig and 
Vernier study warrant special comment. They 
found that the typical depressive pattern was 
absent in their cases. Instead their research 
showed an organic pattern, but was distin- 
guished from the usual organic profile by the 
adequate form level, adequate populars, and 
an average total number of responses above 
fifteen. They likewise report a prolonged reac- 
tion time. Their cases show an increased W 
and F%, a decreased M, D, and O respon- 
siveness, and few shading responses. 

In a relatively recent study by Young [12] 
13 cases of involutional melancholia were given 
the Rorschach. He finds a distinct pattern 
for these cases differing from other types of 
mental abnormality. Response average was 
low, W was increased, M reduced or absent, 
C was absent or variable, and animal and ana- 
tomical responses predominated. (Qualitative 
factors were stressed. The more important 
ones included: depreciatory remarks, stereo- 
typy, paucity and rigidity of thought, and ir- 
relevant responses. 

It seems clear from a brief review of the 
literature that most of the evidence that is 
available on the quantitative structuring of the 
Rorschach in this area has to do with the re- 
cords of depressives, both neurotic and psycho- 
tic. Since one of the basic elements in the invo- 
lutional picture is that of depression, it has 
generally been assumed that the depressive di- 
agnostic pattern revealed in the literature could 
be used to make a correct diagnosis of involu- 
tional psychosis. If the depressive element was 
the key element underlying these several men- 
tal illnesses presumably the Rorschach re- 
sponses would be affected in a substantially 
similar way. 

Subjects 


The subjects used in this study were 45 
carefully diagnosed female involutional psy- 
chotics admitted to a state hospital. Twenty- 
two of the cases were diagnosed as involutional 
psychosis proper, and 23 cases were diagnosed 
as involutional psychosis, paranoid type. The 
mean age of the subjects was 49.3 years with 
a standard deviation of 4.4. The mean number 
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of years of education was 8.4 with a standard 
deviation of 4.8 years. The mean intelligence 
quotient for 28 of these patients, taken from 
the Wechsler-Bellevue, was 92.3. There were 
no statistically significant differences between 
the mean age and the mean years of education 
of the two diagnostic subgroups. Thirty-five of 
the subjects were housewives and 37 of them 
were married. All the patients were oriented 
in the usual psychiatric sense. Thirty-four of 
the patients had accelerated motor behavior, 9 
were normal in this respect, and 3 were re- 
tarded. 
Discussion of Results 


The present data indicate that both the 
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quantitative and the qualitative picture pro- 
vided by these involutional cases is not even 
remotely similar to the usual depressive pic- 
ture, whether neurotic or psychotic. Setting up 
involutional psychosis a> a separate disease en- 
tity, as is argued by most psychiatric authorities, 
finds considerable support in the data of the 
present involutional group. An examination of 
Table 1 presents some of the facts that can be 
used in support of such a contention. Certain 
of these findings are worth emphasizing. 


The involutionals certainly do not produce 
the number of achromatic responses in propor- 
tion to the chromatic ones which are generally 
to be expected in a depressed patient. For the 


Table 1 


Rorschach Test Characteristics of a Group of Forty-five Cases of Involutional Melancholia 








1 otal 





Paranoid Depressed 
Score (N = 23) ( sz 32) (N — 45) + * 
Mean SD Mean SD Mean SD Med. Md.D 

Total R 10.89 3.56 9.23 3.73 10.08 3.74 10.20 3.02 01 
Total time 426.0 173.6 442.0 152.7 434.0 163.8 412.0 135.2 .02 
Time per R 39.30 17.70 50.40 22.70 44.70 21.00 40.20 16.31 .20 
Av. reac. time 

Achro. cards 16.35 9.80 16.55 10.45 16.45 10.10 13.60 7.51 .22 
Av. reac, time 

Chro. cards 13.75 7.90 15.65 9.15 14.80 8.60 13.20 6.52 1.07 
W 5.39 2.08 5.32 2.28 5.36 2.18 5.00 4.89 .21 
D+d 5.39 2.90 4.32 2.93 4.87 2.96 4.00 9.53 .23 
Dd+S 0.17 0.37 0.27 0.67 0.22 0.56 0.00 0.22 10 
F 7.22 3.11 5.59 2.66 6.42 3.01 6.33 2.39 2.53 
F% 69.30 21.20 60.90 22.10 65.30 22.10 64.50 16.20 1.81 
M 0.17 0.37 0.14 0.35 0.16 0.36 0.00 0.16 01 
FM 0.30 0.55 0.64 0.37 0.47 0.93 0.00 0.47 58 
m 0.17 0.48 0.05 0.22 0.11 0.39 0.00 0.11 23 
FC 0.39 0.92 0.23 0.42 0.31 0.72 0.00 0.31 08 
CF 1.00 1.24 1.17 1.56 1.09 1.43 0.00 1.09 02 
C 0.09 0.28 0.14 0.35 0.11 0.32 0.00 0.11 .002 
Sum C 1.33 1.35 1.53 1.76 1.42 1.57 1.00 2.65 .01 
Sum ¢ 0.52 0.65 0.64 0.78 0.58 0.71 0.00 0.84 .02 
Sum C’ 0.56 0.72 0.86 1.17 0.71 0.98 0.00 0.71 02 
Sum K 0.52 2.04 0.32 0.76 0.42 1.54 0.00 2.53 01 
AX 42.30 22.45 61.80 21.98 51.80 24.27 52.70 18.06 2.84 
P% 2.04 1.12 2.73 1.17 2.38 1.20 2.46 0.75 .20 
O% 0.70 1.08 0.05 0.22 0.33 0.87 0.00 0.38 5.92 
Cards 8, 9, 10/R 29.90 6.00 31.41 7.96 30.82 7.00 30.78 5.85 1.79 
M:C equals 

0:0 to 0:2 70% 64% 67% 18 
FMm:FecC’ 

0:0 to 0:2 65% 55% 60% .53 
H+A>Hd+Ad 747% 86% 80% .30 
W (3x) 2M 91% 86% 89% 


-003 





* With 1 df, x? must reach 3.84 to be significant at .05 level. 
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present group the sum of the chromatic re- 
sponses was actually larger than the sum of 
the achromatic responses. The emotional re- 
sponsiveness of the involutionals is indicated 
further in the predominance of the CF and C 
over the FC responses. There were no M re- 
sponses in the group of any consequence. Of 
the total of 45 cases only 6 had any M re- 
sponses, and each of these had only one M. 
The movement response is obviously not pro- 
duced by the involutionals. It may be as Ror- 
schach suggests that people with accelerated 
motility produce few M and more color re- 
sponses. These three factors then characterize 
this group. The average F% is high in this 
group but it is also considerably lower than 
has been reported, without data, in much of 
the literature. The responses that generally 
accounted for the lowered F% were the Fc, 
c, and CF responses. Of additional consider- 
able importance in support of the rejection of 
the usual depressive profile for the involution- 
als is the almost total absence of the F+ re- 
sponse. Form responses of involutionals are 
characteristically mediocre or poor. The pro- 
portion of W responses is approximately the 
same as for other types of “depressed”’ patients, 
perhaps slightly lower. Response and reaction 
times of the involutionals however tend to be 
within the normal range rather than exagger- 
ated as in depressives. The involutionals char- 
acteristically give quick responses even though 
there is considerable clinical anguish and des- 
pair. On the other hand it often took literally 
hours to get these patients to continue respond- 
ing between certain cards. It is also possible to 
say in the light of the evidence that these pa- 
tients are not typically stereotyped as has been 
reported for other types of depressives. This 
can be determined from the type and from the 
variety of the content. 


The findings with respect to the proportion 
of the H+ responses to the H..+Ad reponses 
was clear-cut. In almost 100 per cent of the 
cases the sum of the H+A responses was equal 
to or exceeded one-half the sum of the Hd+A4d 
responses. It seems clear that as far as the in- 
volutional records go, the human and animal 
part responses are not excessively proportionate 
to the human and animal whole reponses. Pop- 
ular responses were also considerably lower 
than expected for the depressives. The average 


P was slizhtly over two rather than the ex- 
pected five. However the number of additional 
populars was high. Here the patient gave the 
“popular” response without the complete detail 
required for popular scoring. This neglect in 
“completing” properly the popular response, 
when given, and the unusual verbalizations of- 
ten associated with the populars, was character- 
istic of the individual P response. 


Despite readily observable intense clinical 
anxiety in the majority of these patients, the 
appearance of K, &, and m responses was ex- 
tremely rare. The mean frequency of all such 
responses was less than one-half a response. 
The anxiety shown in these protocols manifests 
itself in ways different from the anxiety signs 
of the typical psychoneurotic [4]. The dif- 
ferences in the quantitative responses to the 
chromatic and achromatic cards are likewise not 
characteristic of the depressive picture. For the 
present data the increased reaction time to 
achromatic cards over the chromatic cards is 
not a typical indicator of depression. The pop- 
ular responses to chromatic cards do not exceed 
the popular responses to achromatic cards. The 
number of rejections to achromatic cards does 
not exceed the number of responses to the 
achromatic ones. 


It is worth noting that, statistically, there 
are no differences of any consequence between 
the paranoid and the depressive subgroups of 
the total involutional sample. This is true for 
all the test factors susceptible to such quanti- 
tative analysis. Using chi square, and applying 
the Yates correction in all instances, as the 
basis for the analysis, none of the differences 
approach an acceptable probability level. The 
O% responses with a chi square of 5.92 reaches 
a p of .01 with one degree of freedom. It is 
reasonably questionable whether this one statis- 
tically significant difference, among so many 
others, has any importance. For all practical 
purposes, and from the quantitative point of 
view, the subgroups do not differ, and the total 
group is homogeneous. In addition since the use 
of a mean and the standard deviation might, 
in relation to the assumptions underlying their 
use, give questionable results, the medians and 
median deviations were calculated for all the 
data. No differences of any consequence for 
these two different measures of central tend- 
ency and dispersion were found for these data. 
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This is clear from the last column of Table 1 
where the comparable statistics are given. 


Qualitative Analysis 


An analysis was made of the 45 involutional 
protocols to determine the nature and the ex- 
tent of the qualitative factors that character- 
ized the group. It was thought that these might 
be even more useful than the more customary 
quantitative factors used in arriving at a dif- 
ferential diagnosis. The approach was induc- 
tive and empirical. The records were read care- 
fully by the investigators and fourteen factors 
were isolated. Eight of these factors had use- 
fully large loadings. 

The use of words and phrases indicating un- 
certainty and the need for reassurance charac- 
terized the entire group. Such expressions as 
“is it right or wrong,” “maybe I said it 
wrong,” “I want to say the right thing,” all 
illustrate a process of thought and feeling that 
reappeared regularly and consistently. Among 
the paranoid subgroup such expressions ap- 
peared in the records of 61 per cent of that 
group, with an average of 4.3 repetitions in the 
records where it appeared. Fifty per cent of 
the depressives had an average of 2.2 such 
phrases in those protocols. Thus over one-half 
of the total group of involutionals used such 
expressions on the average of three and one- 
half times per record. 

The total number of rejections of the cards 
represents an important aspect of the records 
qualitatively. Sixty-one per cent of the para- 
noids had a total of 32 rejections for an aver- 
age of 2.3 rejections per person doing any re- 
jecting. Fifty-nine per cent of the depressives 
had a total of 46 rejections, or an average of 
3.5 rejections for each patient in this group. 
Rejection rates are thus approximately the 
same for both subgroups and are found in 60 
per cent of the cases of involutionals. The most 
frequently rejected cards are six, seven, and 
nine. The least frequently rejected cards are 
one, five, and eight. All cards showed some re- 
jections. The order of frequency of rejections 
was: cards six, nine, seven, ten, three, four, 
two, eight, one, and five. 

Considerable self-reference characterizes the 
group. Several examples of this type of ref- 
erence will help to explain what is meant 
by this term. The patients said such 
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things as “am I crazy,” “can’t my husband 
take me out,” “I don’t want to die,” “you are 
leading me to the gallows.” There were nu- 
merous hypochondriacal complaints. Of a total 
of 23 paranoids 13 or 57 per cent used such 
forms of self-reference. It was used 2.6 times 
on the average for this group. The depressive 
subgroup of 22 patients showed 45 per cent us- 
ing such self-reference for an average of 3.1 
times. One-half of the total group of involu- 
tionals used self-reference a total of 65 times 
for an average use of 2.8 times for the users. 

Sexually toned responses were frequently 
used, especially among the paranoid patients. 
Typically the sex response was evasive and 
general. Examples are: “newborn,” “below a 
woman’s stomach,” or “this one makes me 
hot.” Some responses were more specifically 
sexual, such as “breast” and “vagina.” Such 
responses occur more than twice as frequently 
among the paranoids than they do among the 
depressive involutionals. Sex responses occurred 
in 57 per cent of the paranoid protocols for an 
average of 3.9 appearances. Only 23 per cent 
of the depressives gave such responses for an 
average of 2.4 times in the protocols where 
they were found. 

Perseveration was markedly apparent in the 
protocols of these involutionals. Eleven out of 
23 paranoids, or 48 per cent, showed persevera- 
tion 42 times, or 3.8 times on the average for 
the persons represented. The involutional de- 
pressed group showed 41 per cent perseverating 
for an average of 2.7 times per protocol. Thus 
approximately one-half of the total group 
showed perseveration on the average of 3.3 
times in these records. 

There are two types of perseveration that 
may logically be distinguished in these records. 
One type of perseveration is the usual kind 
which appears in the presence of the F— re- 
sponse. The other type usually appears three 
or more times successively but is not accom- 
panied by the F—. This latter type is deci- 
dedly more frequent and typical here. Of a 
total of 20 out of 45 cases that showed any 
perseveration, the latter type was found in 70 
per cent of the cases. Such things as body, 
flower, Xray, bones, animals, just colors, are 
typically perseverated. 

The characteristic perseveration seen here 
reflects a sort of mental or associational “sticki- 
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ness” without impairment of intellectual con- 
‘trol. This may be a temporary limitation on 
perceptual variability, or an inability, because 
of intense anxiety, to depart easily from the 
quickly seen or accepted. It is a perseveration 
of fear, of avoidance, of vacuity, rather than 
one of dissociation or deterioration. 


Many of the women had the practice of 
ascribing undesirable characteristics to the 
blots. They used such words as, “mean, evil, 
frightful, having horns, like the devil, unclean, 
and threatening.” In the paranoid group such 
expressions occurred 18 times in 5 protocols, 
or in 22 per cent of the cases. In this group 
the average occurrence was 3.6 times. The de- 
pressives showed this in twice as many, or in 
45 per cent of the protocols, the average occur- 
rence in these records being 1.6 times. For the 
total group this type of response occurred in 
one-third of the cases with an average frequen- 
cy of 2.3 times. 


F— responses were infrequently found in 
these involutional protocols. Only ten out of a 
total of 45 protocols showed such a response. 
Of this small group 90 per cent are found 
among the paranoids. The records that have 
this type of response show it on the average of 
3.2 times per protocol. 

Paranoid references are seen in one-half of 
the paranoid group and not at all in the de- 
pressive group. This is one qualitative feature 
that definitely distinguishes the two groups, as 
might be expected. The 52 per cent of the para- 
noid subgroup who made such responses gave 
them on the average of 2.3 times per protocol. 


Certain facts stand out in evaluating the 
qualitative response characteristics of this invo- 
lutional group. In the first place the sub- 
classification of the group into paranoids and 
depressives reveals certain important differ- 
ences between them, as well as important sim- 
ilarities. Presumably these differences should 
have some value for differential diagnosis with- 
in the group. The subgroups are homogeneous 
with respect to expressions of uncertainty, need 
for reassurance, self-reference, perseveration, 
and rejections. Depressives ascribe undesirable 
characteristics more frequently, while sex, par- 
anoid, and F— responses occur more often 
among the paranoid involutionals. 
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Summary 


The protocols of 45 involutional melancho- 
lics were analyzed quantitatively and qualita- 
tively. The findings of this analysis were con- 
trasted with those of similar studies to deter- 
mine differences and reliable diagnostic indica- 
tions. The results indicate a pattern in involu- 
tionals consistently dissimilar from the usual 
depressive picture, whether neurotic or psycho- 
tic. Involutional patterns can be discerned with 
reasonable diagnostic accuracy when both quan- 
titative and qualitative factors are employed. 
Quantitative factors differentiate the involu- 
tional from other types of mental disorders. 
Significance figures show that only qualitative 
factors aid in the differential diagnosis of para- 
noid and depressive involutionals. 
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In a recent study Thiesen [2] has identified 
several quantitative combinations of Rorschach 
structural variables as being associated with 
schizophrenia. Five tentative patterns are of- 
fered as being of diagnostic value in differenti- 
ating between a patient group diagnosed as 
schizophrenics and a “normal” control group. 

Such a pattern-analytic approach to the 
Rorschach may succeed in isolating combina- 
tions of Rorschach variables which may identi- 
fy certain pathological groups. This approach 
may be regarded as a step closer to establishing 
the validity of discrete Rorschach variables. 


Thiesen [2] is aware of the limitations of 
his findings and points out the need for cross- 
validating the patterns which have emerged 
from his investigations. In the present study, 
the authors have attempted such a cross-valida- 
tion by applying Thiesen’s findings to another 
schizophrenic sample. 


Procedure 


The subjects used in the present study were 
taken from a group of hospitalized male pa- 
tients diagnosed as schizophrenic by the psy- 
chiatric staff of a Veterans Administration 
Hospital. Rorschach tests were administered 
individually to the patients by the authors who 
utilized Beck’s revised scoring system [1]. 
Only those records having ten or more scor- 
able responses were retained for this study. 
A total of 42 protocols was obtained. 

The Rorschach variables which comprised 
the patterns suggested by Thiesen [2] as be- 
ing associated with schizophrenia were selected 
from the protocols. The numerical value of 
each variable was assigned to one of three 
categories of magnitude, “low, medium, and 


*From the Veterans Administration Hospital, 
Lebanon, Pennsylvania. 
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high,” as established by Thiesen on a normal 
control group. Tables were then constructed 
which described the frequency of occurrence 
of the suggested patterns in the present sample. 
These data were analyzed by the chi-square 
technique. 

Results 


In Table 1 are listed the five patterns sug- 
gested by Thiesen. Here comparisons are 
made between the findings of the present study 
and Thiesen’s control group. In patterns 4, B, 
C, and E no significant differences were ob- 
tained, while pattern D was significant at the 


.05 level. 











Table 1 
Patterns Associated with Schizophrenia 
Frequency ri as hi 
Pattern Description Controls Patients square 
. oe Cl 
A An: High 1 1 .02 
Sex: High (0.6%) (2.3%) 
B F+%: Low 
Z Score 2 2 .66 
Low (1.39%) (4.7%) 
C FC+: Low 
M: Low 0 1 50 
AN: Low (0.0%) (2.3%) 
D F+%: Low 
P: Low } 1 3 4.20 
A%: Tow) (0.6%) (7.19%) 
E DW: High 
FC+: Low ! 1 1 .02 
1 (0.6%) (2.3%) 








Table 2 indicates the frequency of occur- 
rence of one or more of the patterns in both 
the present sample and Thiesen’s control 
group. It is observed that 7 of the 42 pa- 
tients or 16.7% were characterized by one or 
more patterns, whereas 5 of the 152 controls 
or 3.2% had one or more of these patterns. 
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There was only a single occurrence of more 
than one pattern in any record, a combination 
of patterns 4 and C. 


Table 2 


Frequency of Pattern Occurrence in Control 
and Patient Populations 








Number of Patterns 








Group None One or More Total 
Controls 152 5 157 
(96.8%) (3.2%) 
Patients 35 7 42 
(83.3%) (16.7%) a 
Chi square = 10.63; p<.0l. 


Table 3 compares the frequency of occur- 
rence of one or more of the patterns between 
Thiesen’s schizophrenic group and the present 
schizophrenic group. The authors’ findings in- 
dicate 7 of the 42 records or 16.7% have one 
or more patterns, while Thiesen reports that 
29 of his 60 patients or 48.3% fall in this cate- 
gory. This difference yielded a chi-square 
value of 9.50, which is significant at the .01 
level of confidence. 


Table 3 


Frequency of Pattern Occurrence in Both 
Patient Populations 








Number of Patterns 








Group None Oneor More Total 
Patients 35 7 42 
( Authors’) (83.3%) (16.7%) 
Patients 31 29 60 
( Thiesen) (51.7%) (48.37%) 
Chi square = 9.50; p<.0l. 
Discussion 


In contrast to Thiesen’s results, which 
showed significant differences of all five pat- 
terns between his patient group and the control 
group, the authors found that only pattern D 
appeared to discriminate between their patient 
group and the controls. Because of the small 
frequency in each cell, this finding may be of 
doubtful significance. 

Thiesen reports the presence of one or more 
patterns in 48.3% of his schizophrenics as com- 
pared with 3.2% of his controls. This would 
be a valuable diagnostic finding. In this cross- 


Murray Lonstein 


Table 4 


Frequency of Occurrence in Magnitude for 
Variables Comprising Patterns 4, B, C, 
D, and E in the Present Schizo- 




















phrenic Sample (N = 42) 

Variable Low Medium High 
An 19 12 11* 
Sex 36 3 3° 
F-+ 17* 11 14 
Z 10* 31 1 
FC + 31* 5 6 
M 16* 24 2 
AN 8* 18 16 
P 22° 18 2 
DW 37 0 > ad 
* Magnitudes of the variables specified in the pat- 


terns. 


validation, however, only 16.7% of the schizo- 
phrenics were found to have one or more pat- 
terns. This shrinkage lessens the clinical utility 
of these patterns. 

Examination of the data in Table 4 shows 
that of the individual Rorschach variables com- 
prising patterns 4, B, C, and E (those patterns 
not found to be discriminatory) only three var- 
iables would appear by inspection to charac- 
terize the present group of schizophrenics. 
These are low FC +, low M, and low P. 

Although the present schizophrenic group 
differed significantly from the control group 
(Table 2), it also differed significantly from 
Thiesen’s schizophrenic group (Table 3). 
This discrepancy indicates a lack of homo- 
geneity in the total schizophrenic population 
sampled in both studies and underlines the 
limited value of the pattern approach. 


Summary 


A cross-validating study was carried out on 
Thiesen’s suggested Rorschach patterns associ- 
ated with schizophrenia. Forty-two schizo- 
phrenic Rorschach records were analyzed, and 
these patterns failed to characterize this group. 


Received January 20, 1953. 
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Differences Between the TAT Responses of 
Negro and White Boys 


Paul H. Mussen 


The Ohio State University 


The extent to which an individual’s projec- 
tions may be determined by group membership 
and sociocultural factors as well as by personal 
idiosyncratic factors has had little systematic 
study. It seems reasonable to assume that 
there will be “consistent differences between 
the fantasy productions of individuals who be- 
long to, or have been socialized in, different 
social groups. Thus, a certain amount of the 
variation in any TAT production can be ac- 
counted for by the fact that the individual has 
grown up in a given milieu or social role” [5, 
p. 16]. Henry [4] found that there were 
systematic differences between the fantasy pro- 
ductions (TAT stories) of Hopi and Navaho 
children which reflected important differences 
between their cultures. 


In their study designed to test the assumptions 
underlying the Thompson TAT, Riess, Schwartz, 
and Cottingham showed that “Negroes and whites 
in the North produce stories that differ insignificant- 
ly in length regardless of whether the stimulus ma- 
terial is Negro or not and regardless of the color 
of the experimenter” [7, p. 708]. Using a reliable 
measure of the number of ideas contained in the 
stories, these same investigators also concluded that 
these two groups “produce ideas in «he TAT situa- 
tion that are not statistically different in number 
regardless of whether the stimulus material is Negro 
or white and regardless of the color of the experi- 
menter” [8, p. 396]. 


Although these findings make it clear that 
differences between Negroes and whites in the 
quantity of production in response to the TAT 
are insignificant, they contribuce nothing con- 
cerning the possible dynamic differences be- 
tween the two groups’ fantasy productions. 
Since Negroes and whites in America grow up 
in different social milieux and consequently are 
subject to different cultural pressures, it may 
be predicted that their responses to projective 


_— 


3 


73 


materials will differ. The present study was 
designed to investigate differences between the 
contents of the TAT stories of Negro and 
white children in New York City. 


Method 


In connection with a study of personality 
and social factors related to changes in chil- 
dren’s attitudes toward Negroes, the author 
[6] administered 13 TAT cards to lower-class 
Negro and white boys from New York City 
who were vacationing at a social agency’s sum- 
mer camp.’ The cards used were: 1, 2, 3, 4, 
6, 7, 8, 12, 13B, 14, 16, and 18GF of the 
Murray TAT and another card, not part of 
the regular series, which depicts’ a smiling 
woman leaning over a baby’s crib and giving 
the baby a pacifier, while a boy about eight 
years old stands behind the crib. 

The data of the present study were derived 
from the protocols of 50 Negro and 50 white 
boys of at least normal intelligence. The sub- 
jects were matched in age so that there were 
equal numbers of white and Negro boys at 
each age level between nine and fourteen. 


All TAT stories were analyzed in accordance 
with a scheme suggested by Stein [9] and modified 
somewhat by the author. The scheme involves 
counting the needs and ,ress of the heroes of the 
stories, the assumption being that the storyteller has 
identified with the hero; the hero’s needs are the 
same as the child’s needs; the press that impinge 
upon the hero are the same as the press that affect 
the child telling the story. 

Twenty-eight needs and 22 press categories were 
employed in the analysis of the protocols. A score 
for each subject for each personality variable (i.e., 
need and press) was derived by adding the number 


1The author wishes to acknowledge his indebted- 
ness to the Community Service Society of New York 
for granting permission to carry out this study at 
their boys’ camp. 
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Table 1 
Number of White and Negro Subjects above the Mean on 50 TAT Variables 
High High Chi- 
TAT Variable Definition of Variable Whites Negroes Square 
N N Value p 
*n Achievement To work at something creditable 24 6 15.40 <.01 
nm Acquisition 1 To work for money, possessions 26 19 1.98 -10—.20 
n Acquisition 2 To steal, cheat, swindle 26 22 64 .30—.50 
n Affiliation 1 Enjoying parent’s company 29 24 99 .30—.50 
*n Affiliation 2 To establish, maintain friendly relations 19 9 4.95 .02—.05 
n Afhliation 3 To fall in love, marry 24 15 3.41 -05—.10 
*n Aggression 1 Self-defensive aggression 22 6 12.66 <.01 
mn Aggression 2 Physical, asocial aggression 29 27 -16 -50—.70 
*n Aggression 3 Emotional, verbal aggression 15 26 4.98 .02—.05 
n Aggression 4 Destruction, smashing, breaking 12 8 1.00 -30—.50 
*n Aggression Killing in anger 30 14 10.36 <.01 
(kill) 
n Autonomy 1 To escape, avoid restraint 13 20 2.21 -10—.20 
n Autonomy 2 To resist coercion 31 33 17 .50—.70 
n Autonomy 3 To misbehave, be unruly 25 35 3.17 -05—.10 
nm Deference 1 To submit unwillingly to another 13 17 7 .30—.50 
n Deference 2 To comply willingly, obey 29 27 16 -50—.70 
*n Deference 3 To express admiration, respect 14 3 8.58 <.01 
n Dominance To lead, manage, influence others 23 18 1.03 -30—.50 
n Exposition To inform, explain 26 24 -16 .50—.70 
nm Nurturance 1 To be kind, helpful to parents 13 18 1.17 .20—.30 
*n Nurturance 2 To be kind, helpful to others 29 18 4.84 .02—.05 
n Nurturance To seek food, drink 17 19 17 .50—.70 
n Passivity To enjoy relaxation 11 20 3.78 .05—.10 
a Playmirth To indulge in pleasurable activity 22 26 64 -30—.50 
nm Recognition To seek approval, prestige 16 9 2.60 .10—.20 
n Regression To think of early childhood 6 7 .09 -70—.80 
nm Succorance To seek aid, sympathy 19 22 .37 -50—.70 
*n Understanding To think, reflect, speculate 18 32 7.84 <.01 
p Acquisition Hero robbed, swindled 20 21 04 >.90 
p Affiliation 1 Hero and parents united 23 19 65 .30—.50 
*p Affiliation 2 Friendly relations established with hero 30 16 7.88 <.01 
p Affiliation 3 Love for hero expressed 21 13 2.85 .05—.10 
p Aggression 1 Retaliation against hero 10 15 1.34 .20—.30 
p Aggression 2 Hero punished 23 18 1.03 .30—.50 
*p Aggression 3 Hero assaulted, injured 10 28 13.70 <.01 
*p» Aggression 4 Hero hated, quarreled with 15 31 10.30 <.01 
*p Deference 1 Hero’s leadership followed 18 7 6.46 .01—.02 
*p Deference 2 Hero admired, respected 34 16 12.92 <.01 
p Dominance 1 Hero forced to do something 24 31 1.98 10—.20 
? Dominance 2 Hero prevented from doing something 17 26 3.30 -05—.10 
~ Dominance 3 Hero persuaded, pleaded with 24 31 1.98 -10—.20 
p Example Hero influenced 11 17 1.78 -10—.20 
p Lack Hero lacks something he needs 16 14 19 .50—.70 
p Loss Hero loses something 29 23 1.34 .20—.30 
> Loss (parents) Hero’s parents die 28 24 64 .30—.50 
? Nurturance 1 Parents help hero 20 28 2.58 -10—.20 
? Nurturance 2 Hero helped, encouraged 19 19 0.00 1.00 
p Physical danger Hero’s well-being threatened 27 19 2.58 -10—.20 
? Physical danger 
(parents) Hero’s parents endangered 23 20 44 -50—.70 
*p Rejection Hero rejected, scorned 18 7 6.46 .01—.02 








* Significant at 5% level or better. 


eee ee ee 


A AER: Leal 


a wi 


Peet Sens Fi of nie 


—-— Aa x. -_— -~ 


tl 
fe 
Ww 


th 
gr 
m 
ed 
vi 


ser 


3) 
tre 
kil 


SiC 


tir 
in; 








li cl hei Ms a RE: eal 


ee Te ey 


eerie che 





Differences Between TAT Responses of White and Negro Boys 


of times it appeared in the thirteen stories. A list of 
the needs and press scores used, together with brief 
definitions of them, is found in Table 1. In order to 
eliminate bias, all scoring was done “blind,” that is, 
independently of knowledge of the subject’s race. 


Results 


The mean score for the entire group of 100 
subjects for each of the 50 TAT scores was 
determined. Subjects having scores above the 
mean score for a given TAT variable were 
considered “high” in that particular need or 
press; subjects having scores below the mean 
score for a given TAT variable were con- 
sidered “low” in that variable. Chi-square 
tests were used to determine whether or not 
there was a significant difference between the 
number of white and Negro subjects scoring 
high on each of the TAT variables. 

Of the 50 chi squares computed, 14 yielded 
chi-square values which were significant at the 
5% level or better. Table 1 lists the TAT 
variables, the number of Negroes and whites 
high in the variable, the chi-square value ob- 
tained, and the level of confidence. There is 
a considerably greater number of significant 
differences than could be accounted for on the 
basis of chance alone. 


Discussion 

Examination of Table 1 makes it clear that 
there are many significant and consistent dif- 
ferences between the contents of Negro and 
white boys’ responses to the TAT. 

The minority group understandably sees the 
general environment as more hostile than does 
the white majority group. Thus, a significantly 
greater number of Negro than white boys tell 
many stories in which the hero is hated, scold- 
ed, or reprimanded (p Aggression 4) or is the 
victim of physical assault (p Aggression 3). 
Despite this, however, their own aggressions 
seem to take a milder form than the white 
group’s. Although they indulge in more verbal 
aggression and hostile thinking (m Aggression 
3), they are relatively less concerned with ex- 
treme aggressive expression (m Aggression — 
kill) and self-defensive aggression (n Aggres- 
sion 1) than are the white boys. 

The Negro’s view of the environment as es- 
sentially inhospitable, also observed by Cot- 
tingham [1], is further reflected in the find- 
ing that a relatively small number of these 
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subjects see themselves as establishing and 
maintaining friendly relations (n Affiliation 
2), respecting others (nm Deference), or being 
kind and considerate of others (m Nurturance 
2). In the same way, they infrequently see 
themselves as being respected (~ Deference 
2), followed, or obeyed by others (p Defer- 
ence 1). 

Their perception of the world as hostile and 
threatening may also imply feelings of inferior- 
ity and helplessness and an attitude of indiffer- 
ence. The broad effects of such an attitude 
may be seen not only in the Negro group's 
relatively infrequent use of extreme forms of 
aggression but also in the relative paucity of 
responses indicating striving for accomplish- 
ment and success (nm Achievement), together 
with an emphasis on generally inactive pur- 
suits such as thinking, reflecting, speculating 
(n Understanding). 

By contrast, the white group considers the 
world to be predominantly friendly and they 
respond to it with more warmth and friendli- 
ness. ‘Thus the heroes of this group’s stories 
are leaders and respected individuals signifi- 
cantly more frequently than the heroes of the 
Negro boys’ stories. Moreover, they are in- 
terested in establishing and maintaining friend- 
ly relations and are more often depicted as 
kind and considerate of others. Since they are 
relatively secure and unthreatened in the world 
at large, they feel free to strive to achieve 
something creditable, to verbalize their ex- 
tremely hostile fantasies, and to defend them- 
selves against aggression. 

Feelings of rejection, generally by the moth- 
er, (p Rejection) are less frequent in the 
stories of the Negro than of the white boys. 
This may be due to the dominance of maternal 
authority and consequent feelings of identifica- 
tion with the mother in Negro families [2], 
or to more general feelings of security in the 
family situation resulting from the highly per- 
missive treatment of very young children by 
lower-class Negro mothers [3]. Since it seems 
that they feel less rejected at home than the 
whites do, the Negro subjects’ attitudes of in- 
difference must be attributed to their percep- 
tions of the world at large as generally hostile, 
rather than to feelings of insecurity in their 
earlier familial relationships. 

Regardless of what their determinants are, 
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feelings of rejection occur significantly more 
frequently in the protocols of the whites than 
of the Negroes. The relatively large number 
of extremely hostile attitudes found in this 
group’s stories is very probably related to these 
feelings of rejection. 

Evidence from the present study clearly 
supports the assumption that there are major 
differences in the fantasy productions of the 
two sociocultural groups studied. In addition 
to personal dynamic factors, the historical, 
economic, and social forces impinging on the 
group are reflected in the stories told by the 
group members. Apparently a certain amount 
of variation in these projective responses may 
be attributed to the individual’s cultural back- 
ground. Some aspects of his fantasy produc- 
tions may be primarily determined — and most 
parsimoniously explained — by the individual’s 
group membership and only secondarily by his 
unique history of interpersonal experiences. 

It follows that interpretation of an individu- 
al’s responses to projective materials must take 
account of his cultural milieu. A great number 
of responses of a certain kind may be quite 
unusual and perhaps indicative of maladjust- 
ment or unresolved conflicts and tensions if 
they are given by a member of one group, but 
usual or “normal” if given by a member of 
another group. The extent of usualness or 
deviation of projective responses must be evalu- 
ated from the point of view of the individual’s 
group membership and cultural background. 


Summary 


The TAT protocols of 50 white and 50 
Negro lower-class boys were analyzed and 
scored in terms of 50 categories of needs and 
press. There were significant differences be- 
tween the numbers of members of the two 
groups with high scores (above the mean for 
all 100 subjects) in 14 needs and press. 

The Negro subjects’ stories contained signi- 
ficantly more incidents of aggressive press from 
the environment and mild, verbal aggressive 
expression by heroes. Compared with the 
whites, they showed less interest in establish- 
ing and maintaining friendly relations, or be- 
ing kind to, or respecting others. The Negro 
boys’ attitudes of indifference were further 


shown in their infrequent use of n Achieve- 
ment and their emphasis on essentially inactive 
pursuits such as thinking and speculating. 

The white boys seem to suffer more from 
feelings of rejection in the family and more 
frequently express extreme hostility in their 
fantasies. On the other hand, they see others 
as respecting them and following their leader- 
ship and they respond to the generally favor- 
able social situation with establishing friendly 
relations, being considerate of others, and striv- 
ing to achieve something creditable. 

There are evidently major differences in the 
fantasy productions of individuals from differ- 
ent social groups. Dynamic interpretations of 
an individual’s projective responses can be 
made meaningfully only if variations primarily 
attributable to his cultural background are 
taken into account. 


Received February 5, 1953. 
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The Use of Sounds in a Projective Test’ 


Harry A. Wilmer * and May Husni 


Stanford University 


An auditory apperception test has previously 
been reported by Stone [2] in a preliminary 
report. This test consists of 10 records of var- 
ious human, animal, and mechanical sounds. 
The only other type of study in the literature 
of an auditory test is that of the Verbal Sum- 
mator or Tautaphone described by Skinner 
[1]. 

Considering the importance of sound phe- 
nomena in human experience and the paucity of 
experimental studies, it was decided to devise 
a brief collection of sounds that could be used 
for clinical or experimental purposes. After a 
preliminary study [4, 5] in which 75 sounds 
were tested with 117 subjects, the prese.it series 
of sounds was selected as being most produc~‘ve 
or leading to the most interesting associations. 
A selection of 21 brief sound recordings has 
been played to subjects to study their response 
to sound perception. The need for a projective 
test using this sensory modality to supplement 
visual projective tests is apparent. Such a test 
would be of obvious value with blind subjects; 
moreover, it might complement the visual tests. 


Method 


Two 12-inch double-faced Vinylite records 
have been produced and are available to other 
investigators. The test records were played to 
individual patients in a room with only the ex- 
aminer and the subject present. Instructions 
given the subject followed this general pattern: 


You are now going to hear a series of recorded 
sounds. Some of them will be familiar, some 
strange. Sounds have associations; they bring mem- 


*Read at the 108th Annual Meeting of the Ameri- 
can Psychiaric Association, Atlantic City, May 12- 
16, 1952. 

?From the Department of Neuropsychiatry, Stan- 
ford University Medical School. Supported by a 
grant from the Palo Alto Medical Research Founda- 
tion, Palo Alto, California. 
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ories, stories, thoughts, and feelings to mind. This 
is true of music, cries, words, and so forth. You are 
going to hear 21 sounds, each lasting 20 to 50 sec- 
onds. [Most patients were not told the time in sec- 
onds but this is being done uniformly now.] Sounds 
have different meanings for different people. We 
are interested only in the meaning these sounds have 
for you. Tell me what your first thought is—what 
comes to your mind—what do the sounds tell you? 
If you wish, make up a story. Are you ready? Now, 
what does the sound mean to you? 


All tests were administered by one of the 
authors (M. H.). The sounds were given one 
after another, usually without comment. If the 
tester felt that the subject was reluctant to re- 
veal further thoughts, a carefully phrased 
query was made, usually by restating the last 
phrase the subject had used but in an inquiring 
tone, such as “Sounds like the train was going 
to leave?” As more experience was gained, the 
positions of examiner and subject were consid- 
ered of some importance. The individual sat in 
a chair facing the loudspeaker and the tester 
sat behind the subject, out of sight, and took 
down the verbatim responses. Thus the effect 
of the appearance and attitude of the examiner 
was kept to a minimum. 

The sounds employed are as follows: 


1. Train (leaving station, crowd, depot noises) 


2. Seagull, seawash; background, 
between two men: 


conversation 


A. Is that enough... ? 

B. Yah. 

A. How much is that? 

B. (pause) Well, just about right... isn’t 
it? 

A. I think that’s just about right. 

B. Put that away now. 

A. Just about right. 

B. Would that cover it better? 

A. Put it away now; are you set? 

B. O.K., let’s go. 


3. Child cry and seagulls, soft background. 
4. Clock striking and crowd noises: “Ya, ya.” 
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5. Slow drip of water. 


6. Organ and poem (male voice, clearly audible 
only on italicized words) : 
To my years hath destiny denied 
The glory of youth. Ah, 
How art thou fed from view, 
Darling companion of my tender age, 
My hope, so sorely mourned! 
Is this the fate that time all men brings? 
Poor wretch, the truth once plain 
Thou wert struck down with ease, thy lift- 
ed hand 
Showing me cold death and a naked tomb 
Afar off grimly stand. 


7. Cry for help and background noises. 


8. Laughter and man and woman conversing: 
A. Where did that damn thing come from? 
B. What thing? 
A. Mother said you can’t always get what 
you want in this world, sister. 
B. What did you expect? 
A. Where is Dad? Where did Dad go? 


9. Music and sobs of woman (15 sec.) and man 


(15 sec.). 
10. Man and woman arguing (man speaks in 
anger) : 
Man: Now what did you do all that for 
today! 


(Mumbling answer). 
Huh? (Mumbling answer). 

You know what I’m talking about! 
(Mumbling answer). 
There’s no excuse for it. 

answer). 
You know damn well what I mean! 
(Mumbling answer). 
You certainly did, and I’m ashamed. 
(Mumbling answer). 
Woman: Well, I wouldn’t talk if I were 
you! 

11. Music and water sounds, ending with rush 
of water (splash like fish in water or man 
drowning). 

12. Father scolding child and child crying: Why! 
Why! Why! 

13. Footsteps, faster, doors open, close, open, rush 
of footsteps. 

14. Baby crying and woman singing softly. 

15. Cry of woman and man. 

16. Sucking sounds (human). 

17. Groaning, rubbing, kissing (human). 

18. Breaking wood, ripping cloth. 

19. Drill. 

20. Humming and whistling (man: Shut up!) 
more humming and whistling. 

21. Train bells (switch engine, 
voices). 


(Mumbling 


loud bang, 


One hundred forty-six protocols form the 
basis of this study. The common factor in all 


but the college group is an enduring handicap. 
In the course of our study only three patients 
became sufficiently upset to necessitate discon- 
tinuing the test. Each of these was in a group 
other than those reported here; they were, 
respectively, a rheumatoid arthritic, and a de- 
pressed boy and woman. ‘The constant recall 
of the crying, which seemed to be all they 
heard, was upsetting. 


The samples are as follows: 


Tuberculosis patients, who were tested at the San 
Mateo County Sanatorium, San Mateo, California, 
with cooperation of Dr. James Greenwell, Medical 
Superintendent. There were 46 patients, 25 maies 
and 21 females, with an average age of 38.7 years 
and a range of 18-74 years. All of the patients were 
on strict bed rest or very limited exercise and had 
been in the hospital from one month to three years. 


College students from Stanford University. There 
were 26 individuals, 15 males and 11 females, with 
an average age of 28.1 years and a range of 22-40 
years. 

Schizophrenic patients were tested at Agnews 
State Hospital, Agnew, California, with cooperation 
of Dr. Walter Rapaport, Medical Superintendent. 
They were all seriously ill committed patients, 
There were 23 paranoid patients, 8 catatonic, 7 
hebephrenic, and 5 mixed type, a total of 43 sub- 
jects. Although the groups here were analyzed sep- 
arately, for practical purposes and statistical reasons 
they will be considered as one group. 


Blind children were tested at the California 
School for the Blind, Berkeley, with the cooperation 
of Dr. B. Lowenfeld. There were 21 children, 11 
males and 10 females, with an average age of 14.5 
years and a range of 10 to 16 years. A third of the 
children were totally blind or could only perceive 
light, while the others had vision of from 1/200 
to 20/200. We have no other children to report at 
this time so the factors of blindness and childhood 
must be borne in mind when evaluating their re- 
sponses in comparison with the other groups. 


Amputees from the Korean War were tested at 
Letterman General Hospital, San Francisco, with 
cooperation of Col. James O. Gillespie, chief of 
professional services. Most of the patients were on 
crutches or in wheelchairs. There were only 10 pa- 
tients in this group, so percentages wiil not be used. 
They had been hospitalized 3 to 12 months. Ampu- 
tated limbs were as follows: one leg, 6; one foot, 
1; both legs, 2; both arms, 1. For administrative 
purposes veterans were required to sign a state- 
ment stating in part: “I further agree to absolve the 
Government of the United States from any ill effects 
which may result in connection with said tests.” 
This statement, implying alleged dangers, must 
have played a role in their attitudes and responses. 
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Table 1 
Recognition of Selected Sound Components 
T.B. College Schizophrenic Blind 
N—% N—2 N= 43 N=21 

Sound No. % % Paranoid ee ll Total % o% 
1. Train 

a. Crowd 50 77 8 8 16 37 15 

6. Human 33 96 0 2 2 38 

c. Street 50 69 8 2 10 23 48 
2. Seawash, conversation 

a. Words repeated 17 27 9 13 22 51 48 

b. Recognized background 15 54 0 0 0 0 81 

c. Crime, police, etc. 26 55 4 4 8 19 90 
3. Child cry, seagulls 

a. Jungle animals 13 54 5 7 9 21 67 

b. Cry mentioned 37 54 14 7 21 49 57 

c. More than one baby 48 23 5 3 8 19 52 
4. Big Ben, crowd 

a. Bells (unspecified) 63 + 0 2 2 5 29 

b. Church bells 46 12 2 9 11 26 24 

c. Sadness, excitement, danger, etc. 52 31 6 a 10 23 28 
5. Water drip 

a. Miscellaneous fluid 22 100 7 3 10 23 95 

b. Running water 35 a 7 . 11 26 48 

c. Poured into something 37 65 8 a 12 28 81 

d. Poured out of something 15 15 8 2 10 2 0 
6. Organ and poem 

a. Words recalled 4 38 1 0 1 2 5 

b. Sadness—pleasure 15 80 1 10 11 7 57 

c. Music 68 54 17 13 30 71 67 
7. Cry for help, crowd 

a. “Help” repeated 57 35 14 10 24 57 62 

b. Violence 41 62 7 + 11 26 95 

c. Remote, unreal 57 35 3 1 a 9 24 
8. Laughter and conversation 

a. Crowd mentioned 59 27 4 5 9 21 76 

b. Laughter mentioned 52 50 10 6 16 38 71 

c. Words repeated 20 8 6 4 10 24 24 
9. Music, sobbing 

a. Crying mentioned 59 85 15 16 31 74 86 

b. Woman crying 27 65 8 14 32 76 43 

c. Unreal, remote 61 69 5 11 26 62 
10. Man and woman arguing 

a. Man mentioned 95 92 18 11 29 69 86 

b. Man at fault 27 12 0 0 0 0 14 

c. Woman mentioned 89 85 13 9 22 52 90 

d. Woman at fault 11 50 4 1 5 12 62 
11. Music and water 

a. Water mentioned 42 81 14 10 24 60 100 

b. Concert 63 27 8 10 18 45 14 

c. Something in water 54 65 11 4 15 37 72 
12. Father scolding son 

a. Provocation indicated 98 85 0 2 2 5 86 

b. Reprimand (not spank) 70 23 11 & 19 49 43 

e. Crying 20 30 6 4 10 26 57 

d. Child’s feelings 77 69 12 5 17 44 15 
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Table 1. (Continued) 











T.B. College Schizophrenic Blind 
N—46 N=—26 N= 43 N=21 
Sound No. % % Paranoid ao Total % % 
13. Footsteps and door 
a. Story indicated 67 42 12 3 15 38 25 
b. Difficulty walking 29 8 1 0 1 3 15 
c. Leaving 14 31 1 1 2 5 45 
d. Fear, anxiety 24 50 5 1 6 15 55 
14. Baby and woman singing 
a. Crying 52 54 il 13 24 62 55 
b. “Mother” 10 $5 11 13 24 62 60 
c. Child’s difficulty mentioned 69 73 1 7 8 20 50 
d. Rocking, singing 67 35 12 14 26 67 60 
15. Cry of man and woman 
a. Death, tragedy 44 32 5 1 6 15 20 
6. Man and woman mentioned 54 40 9 2 il 28 46 
c. Woman alone 28 8 7 12 9 49 7 
d. Laughter (not on recording) 9 0 0 2 2 5 20 
16. Sucking 
a. Total oral sounds 14 40 9 4 13 34 38 
b. Person mentioned 33 56 7 i x 22 28 
c. Mechanical sounds 43 24 6 + 10 26 19 
d. Sucking recognized 12 s 1 2 3 8 14 
17. Groaning, rubbing, kissing 
a. Sleep described 60 16 5 6 11 27 11 
b. Sleep mentioned 86 37 10 12 22 55 42 
c. Dreaming 43 8 1 1 2 5 37 
18. Breaking wood, tearing cloth 
a. Tearing 30 71 10 8 18 45 83 
b. Wood mentioned 17 37 3 2 5 12 17 
c. Grinding, drilling, machinery 32 0 0 3 3 7 0 
19. Drill 
a. Saw, sawmill 59 61 4 3 7 20 13 
b. Big log sawed 17 4 0 0 0 0 
c. Power described 35 9 0 1 1 3 7 
20. Humming, whistling, “shut up” 
a. Humming (woman) 71 48 12 8 20 53 63 
b. Whistling (man) 64 48 12 11 23 61 58 
c. “Shut up” 50 39 8 14 37 63 
d. Man justified 19 26 3 0 3 g 42 
21. Switch engine, loud “pop,” crowd 
a. Train 60 17 9 9 13 49 33 
b. Bell (train) 16 0 0 3 3 8 11 
c. Gun or explosion 27 20 5 2 7 19 23 
d. Streetcar 14 0 3 0 3 & 6 





All patients were male, with an average age of 
23.2 years and a range of 18-36 years. The small 
number of subjects, the single sex, and the signed 
statement set this group apart. 


The responses of individuals to the sounds 
were analyzed according to their recognition of 
certain selected sound segments of each of the 
21 sounds. For example, in the first sound, al- 


though there are a number of components, the 
three with the greatest response or divergence 
of response were selected for comparison and 
analysis in this study. The great difficulty in 
evaluating subjectively complex responses to 
subjectively complex auditory stimuli will be 
obvious. So as to avoid opinions and experience 
interpretations the sounds were fragmented in- 
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to their component parts and the answers tabu- 
lated in relation to the frequency of similar 
responses to sound components. 

The percentage of e.~* ot the groups recog- 
nizing or acknowledging in any way the com- 
ponent of each sound is given (Table 1). The 
number of amputees was too small to include. 

The test required an average of about 35 
minutes to administer, with a range of 25 to 85 
minutes. The longest average time was 38.8 
minutes in the case of the hebephrenic and cata- 
tonic schizophrenics, and shortest in the ampu- 
tee group, 28 minutes. Eighty-six per cent of 
the subjects completed the entire test and 97% 
completed at least half. Only 7% rejected part 
of the test for personal reasons, viz., “I’m not 
nuts,” etc., and 7% were unable to finish for 
reasons beyond their control, such as mealtime 
in the hospital, etc. Six patients refused the 
test completely before it was begun, three of 
these being amputees who had to sign a release. 


Sample Responses 


A 26-year-old paranoid schizophrenic patient 
responded to Sound 7 (cry for help) in the 
following manner: 


That would appear as if a person were cxlling 
for help, could be any state, either mental or physi- 
cal...the person is calling from...I felt precisely 
that way a number of times, and I assure you it’s 
not a very pleasant feeling. . .it’s a feeling of ex- 
treme confusion. Q: Extreme confusion? A: Yes, 
or wanting something that wus not available. There 
are certain personalities that affect you. ..that man- 
ner...having someone repeat the facts over and 
over...gave me that feeling of yelling for help. 
Q: Of yelling for help? A: Yes, that’s in a remote 
sense. I want to be away from that person...I don’t 
want to be with him. (25”) In fact, I would say that 
sound would represent a mental picture of how I 
felt so many times. (15”) I have an older brother 
..-and specially my older brother has always... 
well, not always, has at times (8”) made more of 
an issue out of the things I said and developed them 
into problems. Whether he realized it or not, it 
bothered me...the fact that I had a paralytic stroke, 
having lived with him. ..after I left the University 
of California I went to live with him. I went to 
work in an oil well...I said I wanted a car. ..and 
he took it over from there (15”) that we painted it 
and put a new top...and he took the car...it was 
a brotherly attitude on his part, but I don’t believe 
he has much insight on my personal taste. 


His responses in general revealed considera- 
ble fantasy, were frequently disjointed. He felt 


a strong identification in the cry for help; it 
connotes confusion and is, he believes, a reason- 
ably good picture of his own mental state, 
while the crowd is being warned away from 
that person. There is no mention of help com- 
ing or of concern of the people for the plight of 
the individual. Although there are many words 
on the two records, the only one the patient 
recognized was the word “help.” 

In the protocol of an eleven-year-old blind 
boy his responses to the cry for help is as fol- 
lows: 


Well, I have two things for that. Could be a 
boxer slowly getting knocked out . . . it could be in 
the old days, getting a beating, or being hanged 
Q: Or being hanged? A: The way he stopped a 
the end, it sounded like he was being hanged.. 
and a courtroom. A boxer would be saying “No, 
no.” I guess that’s it. 


The patient does not mention the word 
“help,” considers the man’s plight could be one 
of two things, both violent physical punish- 
ment, and that it could have been in remote, 
ancient times. He seems to feel that the sudden 
end is the consequence of being choked, and 
imagines that the word “no” might be said by 
a boxer being beaten. 

This protocol was one of rich fantasy, mul- 
tiple associations employing “this or that” or 
“first this, then that.” He often approached the 
sound as if he were attempting to classify it, 
then changed his mind in the course of his re- 
sponse. There was an unusual amount of iden- 
tification of physical setting and time. His 
concern was largely with unseen dangers or 
with danger that would not directly affect him. 
Violence and danger were further indicated in 
the protocol by smuggling, robbing, shooting, 
hanging or being knocked down by an ap- 
proaching dog. 

He mentioned the words in five sounds. 
When he indicated food in Sound 10, it was 
being burnt (identifiable by nonvisual sense) 
and in Sound 13, the footsteps sequence, a 
burglar was robbing the house because every- 
one was asleep (eyes closed) and the burglar 
beat him over the head, knocking him out (so 
that his eyes would not open). The man who 
was sick was sleeping and “could be curtains.” 

These samples will serve to illustrate types 
of responses. Personal life associations and 
memories in responses were unusual and oc- 
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curred most frequently in the college students 
and the schizophrenic patients, followed by the 
tubercular, blind, and amputees, in that order. 
There was an average of five personal associa- 
tions in the college group, most frequently in 
Sound 1 (35%), and most frequently in the 
schizophrenics (17%) in Sound 9, music plus 
sobbing sequence. The paranoid schizophrenics 
and the other forms of schizophrenics have the 
same percentage of personal associations. 


Results 


A study of the responses of subject groups 
can be summarized as follows: 

Tuberculosis patients. Heard appeal most 
often, cries least often. Angry crowd, death and 
tragedy (mood) but not violence (action) 
were inferred most often. They heard laughter 
most often, even when not in actual recording. 
They were keenest to walking difficulties but 
least keen to perceive oral sounds. Though they 
described hungry babies crying, like all other 
groups, the children were never fed, and only 
once “going to be fed soon.” 

College students. It can be surmised that 
they had emphatic affective responses, with 
strong feelings for right and wrong, with 
considerable anxiety. They had a high response 
to crying and a low one to laughter. Their re- 
sponses indicating violence and sadistic behavior 
were equalled by those of the blind children. 
One does not know the incidence of neurosis 
among this sample, but this could be a signifi- 
cant factor. They heard the doors open and 
close most often; like all groups, if the doors 
were heard only to open or only to close, the 
males predominated over the females about 
2:1. If doors both opened and closed, males 
predominated about 4:3, which is not consid- 
ered significant because of the slight male pre- 
dominance of the total sample. In the tubercu- 
losis group, for example, it was only males who 
heard the door open, while in the college group 
the two female subjects indicating the door 
opening only mentioned that it opened two or 
three times. 

Schizophrenic patients. The paranoids paid 
little attention to words; violence, death, 
tragedy, and laughter were least frequently 
heard, but crying commonly. Their responses 
were definitive, not often guarded, were rich 
but with little movement, oral sounds or needs 


or gratification responses. 

Blind children. These found the elements of 
violence, death, and struggle more frequently 
than any other group. They detected back- 
ground noises keenly but tended to reject other 
components of sounds when they fixed their 
verbalization on the danger elements. They 
were inclined to refer to the womzn and her 
efforts most often. Their own handicap is re- 
flected by comments about walking, unseen 
danger, and warning signals. They referred to 
sucking most often but not to sleep unless there 
was danger in the sounds. 

Considering the small sample of amputees 
the most striking feature was the poverty of 
responses and the subjects’ expressed difficul- 
ties in understanding the sounds. They practi- 
cally never referred to words but frequently 
referred to the affective sounds of laughing 
and crying. When music was associated with 
crying, music was rarely heard; on the other 
hand, when music was heard with water, music 
was frequently mentioned. It would seem the 
impact of crying tended to overshadow music. 
They referred to violence only once. It is inter- 
esting that in the final sound, where a gunshot 
or explosion is often inferred, this was only 
once acknowledged, then as “‘pop.”’ These vet- 
erans, having returned from the Korean War 
within recent months with loss of limbs, ex- 
cluded the verbalization (and recognition?) of 
the significant meaning of violence. They were 
most productive of feeling responses in the 
sound of the father scolding the child. 


Discussion 


There are certain limitations to the present 
study. Although we analyzed 146 protocols, 
we do not yet know the value of this test as a 
projective technique, nor its predictive or in- 
terpretive importance. We do not have a group 
of nonblind children, and, in essence, our study 
of blind children permits only comparison of 
them to sighted adults. This is significant, as it 
is the setting in which all psychotherapy with 
the blind takes place. Subsequent study of the 
nonblind will be reported. Our so-called nor- 
mal group (college students) probably consti- 
tutes a segment of presumably non-ill young 
adults. It is considered as a group for compari- 
son rather than controls, which must include 
subjects of all ages and in all walks of life. This 
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distinction between normal controls and sample 
for comparison is important. 

Despite the fact that we do not yet know the 
value of this test as a projective technique, it 
meets the criteria for such a test as set forth 
by Rapaport [3]: (a) economical, i.e., not 
time-consuming; (4) simple, i.e., feasible for 
office examination and not requiring complicat- 
ed or bulky apparatus (but does require a rec- 
ord player of good tone quality) ; (c) imper- 
sonal, i.e., does not involve the need to build up 
time-consuming transference relations or com- 
plexes of intense interpersonal relationships, 
such as are present in psychodrama; (d) limit- 
ed to one segment of “behavior”; (¢) standard 
in the sense that all subjects face the same ma- 
terial and the same degree of cooperation from 
the examiner. 


Summary 


A sound projection test employing 21 sounds 
on two 12-inch double-faced Vinylite records is 
described. They include simple and complex 
mixtures of verbal, nonverbal, mechanical, and 
natural sounds. Copies of these records are 
available for research purposes. 

Protocols of 146 subjects are analyzed. 
These include tuberculosis patients, schizo- 
phrenics, college students, blind children, and 
Korean War amputees. No norms can be given. 
The value of the test in interpretation of per- 
sonality structure remains to be understood. 

Tuberculosis patients heard words of appeal 
and crying and inferred violent action more 
than other groups. They described the mood of 
sadness and tragedy as well as laughter more 
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than the others. 

College students gave a high response to cry- 
ing but low to laughter. They indicated a 
high degree of violence and sadistic behavior 
responses. They gave the most frequent human 
and mechanical movement responses. 

Schizophrenic patients ignored the words 
and referred least often to violence, death, and 
tragedy as well as to laughter. They acknowl- 
edged the crying in large proportion. 

Korean War amputees rejected the explosive 
and gun responses and the violent sounds, but 
gave rich associations with the father-scolding- 
son sound. 

The blind children gave the most frequent 
recognition of violence and sadistic activity, 
heard the words of appeal and anger most 
often, and reflected their own handicap in their 
responses of unseen danger. 


Received December 22, 1952. 
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Overinclusive Thinking in a Schizophrenic and 
a Control Group’ 


Seymour Epstein 


University of Massachusetts 


For any task to be properly performed, it is 
necessary to include behavior appropriately 
related to the task and exclude behavior inap- 
propriately related to it. A failure adequately 
to include or exclude is held by Cameron [1, 
3, 4, 6, 7, 8] to be characteristic of certain 
types of maladjustment. According to 
Cameron overinclusion favors disorganization 
whereas underinclusion? is resorted to in an 
attempt to preserve or achieve stability. In 
terms of diagnostic categories, the conversion- 
hysteric is viewed as a pathological under- 
includer, the schizophrenic as a pachological 
overincluder. A review of the literature reveals 
several studies which have reported overinclu- 
sive thinking among schizophrenics [1, 2, 3, 4, 
14, 15]. Some have noted underinclusive think- 
ing as well [14, 15]. The purpose of the pres- 
ent investigation is to investigate more thor- 
oughly schizophrenic overinclusion by attempt- 
ing to answer the following questions: 

1. How prevalent is overinclusive thinking 
among schizophrenics? Do they overinclude 
more than matched controls? Is overinclusion 
more characteristic of some schizophrenic sub- 
types than others? 

2. Is overinclusive thinking more character- 


1Based upon a thesis submitted in 1950 in partial 
fulfillment of the degree of Master of Arts at the 
University of Wisconsin. The writer wishes to 
express his gratitude to Dr. Ann Magaret for her 
advice and guidance. 


An abstract of this paper was presented at the 
1951 meeting of the Midwest. Psychol. Assn. 


At the time this study was carried out the author 
was a trainee in the Veterans Administration pro- 
gram. He wishes to express his appreciation to this 
organization for its support of the study. 


2Underinclusion, as used here, has the same mean- 
ing as Cameron’s term, overexclusion, and has been 
substituted merely for reasons of readability. 


istic of schizophrenics than underinclusive 
thinking? 

3. What variables, such as sex, vocabulary 
level, abstract-thinking ability, and intellectual 
impairment, are related to verbal overinclu- 
sion? 

4. What kinds of words are schizophrenics 
most apt to overinclude? Is overinclusion a gen- 
eral characteristic of schizophrenic thinking or 
is it restricted to certain kinds of stimuli hav- 
ing particular significance in terms of individ- 
ual needs and expectancies ? 


Procedure 


Description of the Inclusion Test. For the 
purpose of this investigation an objective paper- 
and-pencil test, the Inclusion Test, was con- 
structed.® 


The test is composed of 50 items, each consisting 
of a key word followed by five response words and 
the word “none.” The testee is instructed to under- 
line all response words which designate things or 
concepts required for the complete thing described 
by the key word. An example of an item is as fol- 
lows: 

MAN arms shoes hat toes head none 

A correct performance requires underlining the re- 
sponse words arms, toes, and head, as every com- 
plete man must have, among other things, arms, 
toes, and a head. For each correct choice omitted, 
a score of one underinclusion is received; for each 
incorrect choice selected, a score of one overinclu- 
sion is obtained. Many of the items contain words 
only superficially related to the key word, such as 
klang associations. Some items contain words meant 
to be emotionally charged. Several key and response 
words are neologisms, and others are so ambiguous 
that they cannot be meaningfully scored. This lat- 

8The scoring system for the Inclusion Test was 
determined by an item analysis of data obtained 
from a preliminary administration to 61 college stu- 
dents. In its final form the college group made an 
equal number of errors of overinclusion and under- 
inclusion. 
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ter type is intended to induce confusion by forcing 
impossible discriminations. 


Subjects. The patient sample consisted of 
38 schizophrenics,* 19 of whom were males. 
Only those schizophrenics were selected who 
had not experienced a shock treatment for at 
least two weeks, who were within the age 
range 20-42, in whose case record no question 
regarding correctness of diagnosis had ever 
been raised, and who were assigned to the less 
disturbed wards. 

The control group consisted of 20 men and 
25 women. They were selected from a larger 
group of 97 tested, on the basis of providing 
a close match with the schizophrenics on age 
and vocabulary level. The controls represented 
a wide range of occupational backgrounds, 
having been solicited from among firemen, 
recreation groups, housewives, hispital attend- 
ants, secretaries, and professional people. 

Testing procedure. The Shipley—Institute 
of Living Scale [13] was administered to- 
gether with the Inclusion Test in order to 
allow for an evaluation of the relationship be- 
tween its scores with overinclusion and to pro- 
vide a means for matching schizophrenics and 


Table 1 


Analysis of Variance for Overinclusion Scores of 
38 Schizophrenics and 45 Controls 











Sum of Mean 
Group Mean squares df square 
Normal 12.49 
vs. 1464.87 1 1464.87 12.03*** 
Schizophrenic 20.92 
Male 15.44 
vs. 61.39 1 61.39 1/1.98 
Female 17.16 
TVocab. 1 19.62 
vs. 
Vocab. 2 14.50 328.65 2 164.32 1.35 
vs. 
Vocab. 3 15.85 
(Error) 9493.96 78 121.72 





*** Significant beyond the .001 level of confidence. 
3 t Vocab. 1 consists of scores of 21-25 vocabulary 
items correct; Vocab. 2 of 26-29 correct; Vocab. 3 of 
80-40 correct. 


*The writer wishes to express his appreciation to 
the staff of Mendota State Hospital, particularly to 
psychologist Phyllis Earnest, for cooperation in se- 
curing the patient sample. 


controls on vocabulary level. Subjects were 
tested individually or in small greups. Every 
effort was made to put the subject at ease and 
to insure his comprehension of the task before 
he was allowed to begin. Total testing time 
rarely exceeded three-quarters of an hour. 


Results 


Results are presented in the order of the 
questions raised at the beginning of the paper. 

Prevalence of overinclusion in schizophre- 
nia. The main object of this study was to de- 
termine whether overinclusion in a schizo- 
phrenic group, as a whole, occurs more fre- 
quently than in a control group. The results 
indicated in Table 1 suggest that it does. ‘The 
mean overinclusion score for the schizophrenics 
is nearly double that for the controls. The 
difference between .roup means is significant 
beyond the .001 level of confidence. 

The next question to be considered is what 
percentage of the schizophrenics can be classi- 
fied as overincluders. This is a difficult matter 
to decide upon because of a lack of normative 
data defining overinclusion. However, inspec- 
tion of the distributions suggests that a score 
of 18 or more overinclusions might be used to 
determine pathological overinclusion, as such a 
cutting point would separate the mode of the 
schizophrenic distribution from the mode of 
the controls. Sixty-three per cent of the schizo- 
phrenics and 22 per cent of the controls fall 
beyond this point. Thus, many schizophrenics 
(37%) do, not overinclude more than most 
controls, and overlap between the groups 
rather than sharp separation is the case. 

An analysis of variance did not indicate dif 
ferences in overinclusion among the subtypes of 
schizophrenia. The sample included 7 ‘“‘mixed’”’ 
or “undetermined,” 12 “hebephrenic,” 14 
“paranoid,” 4 “catatonic,” and 1 “simple.” De- 
spite the lack of significant differences, the or- 
der of the means of the subtypes did suggest 
that the greater the personality disorganization, 
the greater the overinclusion. 

Overinclusion in relation to underinclusion. 
An analysis of variance for the underinclusion 
score, analogous to he one for overinclusion in 
Table 1, reveals no difference betwen the schi- 
zophrenic and control group in mean under- 
inclusion. Of interest is the observation that 
the controls make about an equal number of 
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erros of overinclusion and underinclusion, with 
means respectively of 12.49 and 12.10, while 
the schizophrenics make almost twice as many 
overinclusions as underinclusions, with means 
respectively of 20.92 and 12.20. It thus appears 
that the difficulty schizophrenics have in ver- 
bally establishing boundaries in the Inclusion 
Test is predominantly a result of a tendency to 
overinclude. 

Overinclusion in relation to other variables. 
Inspection of Table 1 reveals that, within the 
range of the sample tested, neither men nor 
women have an option on overinclusion, nor is 
it influenced by vocabulary level. Abstract- 
thinking ability, as measured by the Shipley 
scale, is also not found to be significantly cor- 
related with overinclusion.® On the other hand, 
the product-moment correlation coefficient of 
overinclusion and the Shipley measure of “in- 
tellectual impairment” is .37 for the schizo- 
phrenic group (N=38) which, when evalu- 
ated by Fisher’s ¢, is significantly greater than 
zero at beyond the .05 level of confidence. 
This result is in line with the interpretation 
of the order of the means of the subtypes of 
schizophrenia, i.e., the greater the disorganiza- 
tion, the greater the overinclusion. 

Kinds of materials schizophrenics over- 
include. A chi-square analysis reveals that 10 
of the 50 items of the Inclusion Test are han- 
dled significantly differently by schizophrenics 
and controls at beyond the .05 level of confi- 
dence. This is considerably beyond the chance 
expectancy of 2.5 items. All five items in the 
test that have neologistic key words are repre- 
sented in the significant 10. In general, con- 
trols make no choice or one choice following a 
neologism, while schizophrenics not infre- 
quently make two. As controls and schizo- 
phrenics were matched on vocabulary, their 
differential handling of neologisms cannot be 
explained in terms of familiarity with words. 
A possible explanation was suggested by spon- 
taneous comments made by some of the pa- 
tients, indicating an uncertainty about what 
they did and did not know. For example, one 
patient, upon coming to the neologism “‘to- 
pitch,” remarked, “Isn’t it a shame the way 


5The absence of a significant correlation cannot 
readily be attributed to unreliability of the Inclu- 
sion Test, as the corrected split-half reliability co- 
efficient for the overinclusion score was found to be 
90 (N=83). 


words you've used all your life suddenly escape 
you?” 

Inspection further indicated that the schizo- 
phrenics inappropriately chose words related to 
material things and sense impressions. Thus, 
more schizophrenics than controls incorrectly 
selected wood as necessary to a Box, whereas 
more controls than schizophrenics incorrectly 
selected corners. Also, schizophrenics, more so 
than controls, tended to select specific examples 
of a category as necessary for that category 
(i.e., a lion is required in order to have an 
Animal). Such behavior is in line with Gold- 
stein’s [11] description of schizophrenic think- 
ing as concrete and indicative of a “loss in the 
abstract attitude.” 

Qualitative analysis further suggested that 
the schizophrenics, more than the controls, re- 
sponded with “loose associations” rather than 
with meaning. By this we mean they chose 
words only incidentally related to the key 
word, such as is the case with klang associa- 
tions. As the Inclusion Test contains a great 
number of associationistic choices, this type of 
response contributed heavily to the schizo- 
phrenic overinclusion score. 

That schizophrenics respond to neologisms 
and choose response words which are concrete 
or only superficially and associationistically 
related to the key word suggests that over- 
inclusion is a general characteristic of schizo- 
phrenic thinking and does not occur only in 
areas having particular emotional significance 
to the individual. 


Discussion 


The findings in this study support Cam- 
eron’s view that schizophrenic thinking is over- 
inclusive. Why no underinclusion was found 
raises a question, as both Shneidman [14] and 
Zaslow [15] reported underinclusive as well 
as overinclusive behavior in their groups. 
Whereas other explanations are possible, we 
suspect the discrepancy in findings is a result 
of differences in the tasks in two respects. For 
one, the Inclusion Test offers many association- 
istic choices, which the schizophrenic seems par- 
ticularly apt to respond to. Thus, overinclusion 
is favored by the nature of many of the indi- 
vidual items. For another, the test as a whole 
is not rigidly structured in that it offers many 
bizarre choices for which there are no correct 
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responses. It may be that underinclusion, when 
it occurs among schizophrenics, is a reaction 
formation to a,more basic overinclusive tend- 
ency in an attempt to prevent or ward off dis- 
organization, and the Inclusion Test, because 
of its confusing nature, disrupts the develop- 
ment of a rigid defense system. Of interest, in 
this connection, was the reaction of one patient 
who underlined only the word none, having 
explained that no response, including the ones 
indicated in the illustrative examples at the 
beginning of the test, met her criteria of per- 
fection. She was negativistic throughout the 
session, becoming increasingly irked with the 
test, and finally refusing to complete it. Had 
she proceeded in her test behavior to the end, 
she would have received a score of extreme 
underinclusion. One is tempted to conjecture 
here that she was able to prevent the collapse 
of her underinclusive defense system only by 
withdrawing from the task. That underinclu- 
sion may be a reaction formation to over- 
inclusion is also in line with reports on the use 
of rigidity as a defense mechanism [9, 10, 11]. 

Why the schizophrenic overincludes, associa- 
tionistically or otherwise, is not immediately 
apparent. Cameron, who originally used the 
concept of overinclusion descriptively [4], has 
more recently attempted to explain it in the 
following manner: “. . . a strong hypothesis, 
arising in response to anxiety-provoking un- 
certainty, begins by broadening the generaliza- 
tion gradient and developing overinclusion. . .” 
[8, p. 306]. Whereas this explanation may ac- 
count for certain kinds of overinclusion, it 
does not account for the results observed in 
this investigation, for on the basis of a “strong 
hypothesis” theory one would predict under- 
inclusion as well as overinclusion in the test 
used here. It might simplify matters if two 
types of overinclusion were differentiated. One, 
the kind resulting from strong needs or expect- 
ancies, could best be included under the con- 
cept of selective perception, and would involve 
overresponding to material related to subjective 
hypotheses and simultaneously underrespond- 
ing to other material. This investigation has 
revealed a different type of overinclusion, 
which we suspect is a result of a failure in 
discrimination, arising out of a defect in at- 
tending. That schizophrenics suffer from an 
attention defect has been shown in several stu- 


dies [5, 12]. Whether such a defect impairs 
discrimination and favors diffuse generaliza- 
tion of the type demonstrated by our schizo- 
phrenics remains for future research to deter- 
mine. Operationally, this hypothesis can be 
tested by determining whether overinclusion 
increases as attention level is experimentally 
decreased, and whether it does so more than 
underinclusion. Obviously, the prediction of 
increasing overinclusion with decreasing atten- 
tion can be expected to hold only within limits, 
for with extreme inattention the individual 
would not be responding at all to the task at 
hand, and so, in a sense, would be underinclud- 
ing. It is therefore hypothesized that the curve 
of overinclusion as a function of decreasing 
attention rises gradually at first, then falls 
sharply when almost all attention is withdrawn 
from the task at hand. 


This study raises several questions. For one, 
it has been shown that on the basis of Cam- 
eron’s concept of overinclusion the reaction of 
schizophrenics to a particular test situation 
could be predicted. But the schizophrenic rep- 
resents only the overinclusive end of the con- 
tinuum. Is Cameron’s theory correct in view- 
ing the hysteric as an underincluder, and 
would such behavior be opposite but analogous 
to schizophrenic overincluding ?® Another ques- 
tion that arises is whether overinclusion is 
characteristic only of schizophrenic behavior, 
or whether it is equally prominent in other 
psychoses. We believe that any state of disor- 
ganization ‘favors overinclusion, but this re- 
mains to be tested. A third matter that might 
profitably be investigated is what other corre- 
lates of overinclusion or underinclusion, be- 
sides “intellectual impairment,” can be found 
to help relate overinclusion and underinclusion 
to clinical behavior. For example, how does the 
non-overincluding schizophrenic differ from 
the overincluding schizophrenic? Does he have 


®In a preliminary study the Inclusion Test was 
administered to six patients demonstrating uncom- 
plicated conversion-hysteric symptoms. Their mean 
scores and the control group’s for both overinclusion 
and underinclusion were almost identical. If this 
result is confirmed by larger studies, it would sug- 
gest that the hysteric does not underinclude exten- 
sively, but perhaps only in regard to material dy- 
namically related to his particular symptom. Such 
behavior would not be opposite and analogous to 
the overinclusion of the schizophrenic, which is dif- 
fuse. 
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a more favorable prognosis? Do rigidity and 
defensiveness favor underinclusion, as was hy- 
pothesized ? Can certain kinds of hallucinations 
be explained in terms of the overinclusion of 
normally unheeded perceptions? A positive re- 
lationship between some kinds of hallucinatory 
experience and score on the Inclusion Test 
would support such a view. 


Summary 

In order to investigate overinclusive think- 
ing among schizophrenics an objective paper- 
and-pencil test, the Inclusion Test, was con- 
structed. The Inclusion Test yields a score of 
overinclusion and a score of underinclusion. 
A comparison on this test of matched groups of 
38 schizophrenics and 45 controls resulted in 
the following findings: 


1. Schizophrenics, as a group, overinclude 
significantly more than controls. Whereas con- 
trols, on an average, make about an equal num- 
ber of errors of overinclusion and underinclu- 
sion, schizophrenics average about twice as 
many errors of overinclusion as underinclusion. 
However, overinclusion is not characteristic of 
every schizophrenic. 


2. Schizophrenics, as a group, do not behave 
differently from controls in regard to under- 
inclusion. 


3. Sex, subtype of schizophrenia, vocabulary 
level, and abstract reasoning are not related to 
degree of overinclusion. On the other hand, 
“intellectual impairment” is positively and sig- 
nificantly correlated with overinclusion. 

4. Overinclusion does not appear to be con- 
fined to material with apparent strong personal 
significance for the schizophrenic. Rather, the 
schizophrenic tends to overinclude stimuli 
which are but associationistically or concretely 
related to the task at hand. He even over- 
responds to words the meaning of which he 
does not know. 

In order to explain some of the above find- 
ings it was hypothesized that underinclusion, 
when it is found among schizophrenics, is a 
reaction to a more basic overinclusive tendency 
in an attempt to prevent disorganization. It 
was further suggested that the kind of over- 
inclusion observed arises from a defect in focus- 
ing attention. 
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Intellectual Deficit in Organics and Schizophrenics 
Sheldon R. Rappaport 


Department of Psychiatry, Albert Einstein Medical Center, 
Southern Division, Philadelphia, Pa. 


This study, part of which was reported in a 
previous paper [20], is an investigation of the 
role of behavioral accessibility in intellectual 
deficit. This paper specifically deals with de- 
termining whether organic or schizophrenic 
psychotics show significantly greater intellec- 
tual deficit on specific tests and whether such 
deficit can be attributed to organic or func- 
tional factors, the latter rated by behavioral 
accessibility scores on the Elgin Test Reaction 
Scale [20]. 

The previously reported selection of the sam- 
ple and conditions of the study are summarized 
below. The test batteries selected to be admin- 
istered to these patients were comprised of test 
items believed to reflect most adequately intel- 
lectual areas in which psychotic patients may 
show deficit. Vocabulary was also measured be- 
cause it is widely held as the best estimate of 
premorbid level of function. It is recognized 
that the designations for these areas are merely 
summative indices of more complex functions 
[17]. 

Because of the difficulty of maintaining the 
cooperation and attention of psychotics, it was 
decided that the selected tests should be ar- 
ranged in two batteries, each requiring approxi- 
mately the same time (usually around 40 min- 
utes) for administration. To introduce each 
battery with a test which would facilitate rap- 
port, to permit proper placement of the digit- 
span test, and to allow for delayed recalls, the 
following order of tests was devised: 


Test I 


1. Information, subtest of the Wechsler-Bellevue, 
I [26]; an index to availability in consciousness of 
a fund of general information obtained by cumula- 
tive interest in the environment. 


2. Recall I, the news item from X, 3 of the Stan- 
ford-Binet, L [22]; an index to the accuracy of im- 
mediate recall of meaningful material. 


3. (a) Digits Forward and (b) Digits Reversed, 
subtest of the Wechsler-Bellevue, I; an index to au- 
ditory attention span. 

4. Memory-for-Designs test, by Graham and Ken- 
dall [7, 8]; an index to the accuracy of visual or- 
ganization and reproduction of imagery. 

5. Recall II (same as 2 above); an index to the 
accuracy of retention and delayed recall of mean- 
ingful material. 

6. Block Designs, subtest of the Wechsler-Belle- 
vue, I; an index to analytic-synthetic thinking. 

7. Vocabulary, the Thorndike short-form of the 
Binet Form L Vocabulary [24]; the best single 
estimate of premorbid level of intellectual function. 


Test Il 


1. Comprehension, subtest of the Wechsler-Belle- 
vue, I; an index to understanding of social factors 
and requirements, as fundamental to-social judg 
ment. 

2. Word Pairs I, the word pairs from the Hunt- 
Minnesota Test of Organic Brain Damage [10]; 
an index to formation of new, rote associations. 

3. Vocabulary, subtest of the Wechsler-Bellevue, 
I; the best single estimate of premorbid leve! of 
intellectual function. 

4. Sorting test, the Weigl-Goldstein-Scheerer Col- 
or-Form Sorting Test [6]; an index to concept for 
mation. 

5. Word Pairs II (same as 2 above); an index 
to retention and delayed recall of newly formed 
rote associations. 

6. Cube test, the Goldstein-Scheerer Cube Test 
[6]; an indication of ability to profit from concrete 
aids in the performance of analytic-synthetic think- 


ing. 
& 


Tests I and II were administered to a patient 
at the same hour on two successive days, accord- 
ing to the prescribed procedures for each of the 
tests used. At each of these two sessions the pa- 
tient’s behavioral accessibility was rated on the 
Elgin Test Reaction Scale (TRS). Those pa- 
tients who failed any of the first four block 
designs in Test I were given the Cube test, de- 
signs I-VI, at the end of Test IT. 
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Scoring Procedure 


Wherever established scoring procedures 
were available, they were followed. ‘Two tests, 
the Sorting test and the Cube test, had no 
such standardized, quantitative scoring meth- 
ods. 


To obtain a quantitative means of evaluating the 
Sorting test, the writer devised a system of weights 
for the various performances on this test. These are 
described in Table 1. This scale is based primarily 
upon the principles set forth by Goldstein and 
Scheerer [6]. 


Table 1 


Scale of Weights for Performance on the Weig]l- 
Goldstein-Scheerer Color-Form Sorting Test 








Spontaneous sorting and shifting, both concepts 
abstract 
19 Both verbalized 
18 One verbalized 
17 Neither verbalized 


Spontaneous sorting and shifting, one concept 
abstract 
16 Both verbalized 
15 One verbalized 
14 Neither verbalized 


Spontaneous sorting and shifting, both concepts 
concrete 
13 Both verbalized 
12 One verbalized 
11 Neither verbalized 


Induced sorting and shifting, both concepts abstract 
10 Both verbalized 
9 One verbalized 
8 Neither verbalized 

Induced sorting and shifting, one concept 

abstract 

7 Both verbalized 
6 One verbalized 
5 Neither verbalized 

Induced sorting and shifting, both concepts concrete 
4 Both verbalized 
3 One verbalized 
2 Neither verbalized 
1 Failed 





To quantify the six steps involved in the Cube 
test [6], Boyd’s method was used [4]. Accordingly, 
making a correct pattern and giving a correct ex- 
planation of this on step 1 are each given a weight 
of 5 points, or a total weight of 10 points. Attain- 
ing a correct pattern and explanation on step 2 is 
given a total score of 5 points; on step 3, 4 points; 
on step 4, 3 points; on step 5, 2 points; on step 6, 
1 point. Hence, because the first 6 designs were 
used in this study, a total score of 60 was possible 
on the Cube test. 


Analysis of the Data 


The schizophrenics and organics were com- 
bined and then were divided into thirds accord- 
ing to the magnitude of their TRS scores. The 
lowest third of the group had TRS scores be- 
low 67, the middle third had scores between 67 
and 74, and the upper third had scores of 75 or 
more. These scores were used to differentiate 
both the schizophrenics and organics into 
thirds. Which third a patient was in depended 
on his TRS score for that day’s testing. Hence, 
because of change in behavior, a patient might 
be in the upper third for Test I and in the low- 
er third for Test II. 


An analysis of variance was made for 14 of 
the 15 tests comprising Test I and Test II. For 
each test, estimates of the population variance 
were obtained from variance attributable to di- 
agnosis, level of behavioral accessibility, the in- 
teraction of these two components, and from 
the within-group variance. The Cube test was 
not so treated because not all patients were to 
receive it. On this test, passing was set arbitrar- 
ily at achieving a score of 3 on each of the six 
designs, or a total score of 18. However, if a 
total score of 18 was achieved without making 
a score of 3 or more on each design, failure was 
recorded. Such inconsistency as achieving a 
score of 10 on two of the designs and then fail- 
ing the others was not considered manifestation 
of having learned from the Cube test aids. The 
scores on the Cube test were treated by deter- 
mining the critical ratio between the percentage 
of schizophrenics and organics who failed any 
of the first four designs of the Block Design 
test and passed the Cube test. 


Results 


An analysis of variance was made to deter- 
mine if test scores would be differentiated by 
diagnosis, by levels of behavioral accessibility, 
or by the interaction of these. The relationship 
between mean scores of schizophrenics and or- 
ganics at each level of accessibility is shown in 
Figures 1 and 2.1 The mean scores and the 


1It should be remembered that the score values 
hold different significances for the various subtests, 
with the exception of those reflecting the Wechsler- 
Bellevue weighted scores. Except in the case of the 
latter scores Figures 1 and 2 are meaningful only 
in comparison of the relative position of the scores 
of organics and schizophrenics within a subtest. 
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Table 2 
F Tests of Mean Scores on Tests I and II by Levels of Accessibility and by Diagnosis 
Levels of accessibility Diagnosis 
Means Jo Loft C Means Jo Loft C 
Up.3rd Mid.3rd Low.3rd forF  Schiz. Organic forF 
Test I 
Information* 8.85 7.35 5.68 1 7.97 6.12 1 
Recall I 8.39 7.08 4.34 1 6.79 6.39 <5 
Digit Span* 7.29 6.03 4.58 1 6.44 5.17 1 
Digits Forward 5.80 5.45 4.84 1 5.56 5.02 1 
Digits Reversed 4.27 3.70 3.13 1 3.85 3.46 5 
Memory-for-Designs 5.68 11.60 12.29 1 7.88 13.39 1 
Recall II 6.93 5.95 3.50 1 5.77 5.00 1 
Block Designs* 9.24 6.10 4.18 1 7.37 5.05 1 
Binet VQ 108.76 91.63 72.05 1 95.62 $3.02 1 
Test II 
Comprehension* 8.56 7.00 3.59 1 7.12 5.63 1 
Word Pairs I 8.21 5.59 3.07 1 6.56 4.13 1 
Vocabulary* 9.15 7.61 5.03 1 7.73 6.83 5 
Sorting Test 5.76 4.76 1.83 5 4.66 3.68 <5 
Word Pairs II 5.53 3.80 2.17 <5 4.62 2.50 <5 
* Means derived from Wechsler-Bellevue, I weighted scores. 
Table 3 
Significant ?’s for Scores on Tests I and II between Diagnoses and among Levels 
of Behavioral Accessibility 
Between schiz. & org. Among schizophrenics Among or anics 
U. M. * U-M M-L U-L U-M M-L U-L 
Test I 
Information 3.40°* 2.26% 1.97° 2.40** 2.80** 5.43** 1.99* 2.65** 
Recall I 3.02% $.56°° 245%* 3.19°° 
Digit span 2.45** 2.62°° 3.599° 2.38°* 
Digits fwd. 2.86** 2.82°*  2.80°° 
Digits rev. 1.97* 3.71% 2.24* 
Mem.-for-designs 3.63% 2.939° 3.29% 3.579° 3.69** 
Recall II 2.11* 3.79% 2.41* 2.29* 
Block designs 2.40%* 4.71** 2.10* 2.96** 4.16** 7.40** 4.36** 4.79** 
Binet VQ 2.15* 2.20* 2.44** 2.60** 3.50** 6.38** 2.11* 2.93** 4.64** 
Test Il 
Comprehension 4.13** §.95%° 436°° 3$.01°° 2.17° 4.11** 
Word pairs I 2.31* 3.40** 2.19* 5.01** 2.00* 2.33* 
Vocabulary 2.05* 4.34** 6.04** 2.53% 
Sorting test 2.25* 2.61** 2.05* 
Word pairs II 4.54** 2.96** 2.39%*  5,29%° 





*1% level of confidence; 
** 5 to 2% level of confidence. 


levels of confidence of F are in Table 2. These 
F tests were derived from the ratio of the vari- 
ance of behavioral accessibility to the within- 
class variance and from the ratio of the vari- 
ance of diagnosis to the within-class variance. 
This procedure was foilowed because in each 
case the interaction variance was found not to 


be significantly larger than the within-class 
variance [14]. Exception to this was found in 


Delayed Word Pairs.” 


2Here the interaction variance was larger than 


the within-class variance at the 5% level of confi- 
dence and thus was used as the error variance. 
Neither of the F’s was then significant. However, 
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Because the F tests showed significant differ- 
ences in scores among levels of behavioral acces- 
sibility and between diagnoses, ¢ tests’ were 
employed te ascertain where the differences lay. 
The magnitudes of the significant ¢t’s and their 
corresponding levels of confidence are shown 
in Table 3. 

Of the organics who failed the Block De- 
signs, 60.60% passed the Cube test, while this 
was true for only 53.40% of the schizophre- 
nics. The critical ratio between these percent- 
ages was 7.69, highly significant. 


Discussion of Results 


Inspection of the preceding tables and graphs 
indicates that on all subtests the schizophrenics’ 
scores vary directly with their level of accessi- 
bility. With the exception of two subtests, this 
is also true of the organics’ scores. These data 
serve to substantiate the high degree of rela- 
tionship already established between psychotics’ 
test scores and their behavioral accessibility 
[20]. These results further suggest that re- 
gardless of the ultimate basis for the illness, 
psychotics show a disturbance of thought pro- 
cess that has at its cause a large behavioral or 
functional element. This agrees with the con- 
clusions of Rapaport [19] and others in contra- 
indicating the traditional psychiatric viewpoint 
of a dichotomy of mental disorders into those 
of neurological and those of psychological ori- 
‘gin. 

Indeed, scores on Recall I, Digits Reversed, 
Recall II, and Wechsler-Bellevue Vocabulary 
seem to reflect only behavioral accessibility and 
do not differentiate organics from schizophre- 
nics at all. This would suggest that findings of 
vulnerability of, for example, digit span [1, 2, 
15] in organics have been due to behavioral 
inaccessibility rather than specifically to brain 
damage. This further suggests that vocabulary 
cannot be regarded as resistant to encroachment 
by disease process and therefore an absolute in- 
dex to premorbid level of function when vocab- 
ulary is so vulnerable to behavioral inaccessibil- 


8In deriving these fs, the within-class variance 
was used as the error term. 





because of the significant interaction variance and 
because of the shape of the curves [25], f tests were 
calculated. Those found to be significant are in- 
cluded in Table 3. 
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ity (viz. Fig. 1). Despite the intimation of 
Allen [1, 2] and others that behavior plays a 
role in intellectual impairment, there still seems 
to be too great a proneness to interpret “‘organ- 
ic” or “deterioration” tests as evidence of im- 
mutable deficit in attention, retention, etc., 
due solely to brain damage. 

On the other hand, the scores on Informa- 
tion, Block Designs, and Thorndike-Binet Vo- 
cabulary are significantly higher for the schizo- 
phrenics than for the organics. Although these 
results agree with previous studies [1, 2, 13] 
in that Block Designs shows greater deficit in 
organics than does Information or Vocabulary 
(Table 2), the present study indicates that 
when compared with schizophrenics, the organ- 
ics show deficit on all three of these tests. ‘This 
cannot be accounted for simply on the basis of 
behavioral accessibility, even though the scores 
of both groups on these subtests are highly re- 
lated to it, because on each of these subtests the 
schizophrenics do significantly better at all 
levels of accessibility (Table 3). On Informa- 
tion and Block Designs the superiority of 
schizophrenic scores is less significant at the 
lowest level of accessibility than at the highest 
level. This indicates that, on these two subtests, 
as behavior becomes more inaccessible, the 
schizophrenics’ performance more closely ap- 
proaches that of the organics. Conversely, on 
the Thorndike-Binet Vocabulary the superior- 
ity of the schizophrenics’ scores is inversely 
proportionate to accessibility. On this subtest 
the schizophrenics’ scores are somewhat less 
vulnerable to poor accessibility than are those 
of the organics. 

The significantly higher scores of the schizo- 
phrenics on these subtests cannot be attributed 
to differences in education, since the critical 
ratio for years of education in these two groups 
is only 0.56. The CR for length of hospitaliza- 
tion is also insignificant. However, a CR of 
2.86 exists between the mean ages of these two 
groups, indicating that the organics are signifi- 
cantly older than the schizophrenics. While this 
factor must be considered, there is some evi- 
dence that age alone would not account for the 
difference, especially in all three subrests [26]. 

The conclusion, then, seems to be that Infor- 
mation, Block Designs, and Thorndike-Binet 
Vocabulary reflect thought processes that are 
impaired in direct proportion to behavioral in- 








terference but that are more severely impaired 
by actual brain damage. 


It is interesting that the Wechsler vocabulary 
completely fails to differentiate the two diagnostic 
groups while the Thorndike-Binet vocabulary does 
so at all levels of accessibility. Derivation of VQ’s 
from the Wechsler-Bellevue weighted vocabulary 
scores shows that the Binet vocabulary is more dif- 
ficult for organics than for schizophrenics. The 
schizophrenics’ Wechsler VQ’s are comparable to 
their Binet VQ’s. However, the organics’ Wechsler 
VQ’s are significantly higher than their Binet VQ’s. 
From inspection of the two vocabularies it appears 
that many words in the Binet vocabulary require 
greater elaboration and encompass more abstract 
concepts than do the Wechsler words. The organic 
patient’s felt impotence and his excessive difficulty 
in conveying his thought in accurate verbalization 
[19] could account for the lower score on the Binet 
vocabulary. 

On both Word Pairs I and Word Pairs II the 
schizophrenics do significantly better than the or- 
ganics only at the upper level of behavioral access- 
ibility. This suggests that organics show intrinsic 
difficulty in the thought processes of formation of, 
and especially in the retention of, new rote associa- 
tions in addition to the deficit imposed by inaccess- 
ibility (Fig. 2). This also indicates that these pro- 
cesses are greatly disrupted by the emotional inter- 
ference of schizophrenia. 

On Digits Forward, Memory-for-Designs, Com- 
prehension, and Sorting test, at the upper range of 
accessibility, the organics function at a level that is 
not significantly different from that of the schizo- 
phrenics. As behavioral accessibility decreases, the 
scores of both groups tend to show greater deficit 
(Fig. 1 and 2), but in general the diagnostic groups 
are not clearly differentiated. However, on Memory- 
for-Designs, the scores of the schizophrenics are 
significantly higher than those of the organics at 
the lower levels of accessibility. Thus, behavorial 
disturbance has greater disruptive effect on the 
thought processes involved in this subtest in the 
case of the organics than in the case of the schizo- 
phrenics. 

The results on the Cube test indicate that a sig- 
nificantly greater percentage of organics than schi- 
zophrenics were able to benefit from the aids offered 
by that test and thereby to learn to construct the 
block designs, which could not be done without 
such aids. In view of this it would seem that the 
organic patient’s difficulty on Block Designs is not 
primarily due to disturbance in analytic-synthetic 
thinking per se but to disturbance in attitude or 
shift which would be a component of such think- 
ing.* Clinical observation reveals that without the 


“Attitude and shift are discussed by Goldstein 
and Scheerer [6] and by Buerger-Prinz and Kaila 
in Rapaport [19]. 
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aids of the Cube test the organic becomes fixated 
on one element of the design and often perseverates 
that operation in attempting to deal with other 
elements. Hence, he cannot transcend by himself the 
immediate situation and effect relationships which 
lie outside of it. The Cube test aids assist him in 
shifting his attitude so that he can learn to complete 
the tasks independently. On the other hand, it ap- 
pears that the schizophrenic’s emotional interference 
prevents him from goal-directed behavior and 
therefore from recognizing the purpose of the Cube 
test aids and from utilizing them. 


Summary and Conclusions 


Two test batteries were each administered to 
42 organics and 85 schizophrenics on two suc- 
cessive days. No patient was of less than dull- 
normal intelligence or over 60 years of age. 
The test data were treated by dividing the pa- 
tients into thirds according to their TRS scores 
and then analyzing the test scores according to 
variance attributable to diagnosis, to level of 
behavioral accessibility, and to the interaction 
of these components. 


Within the limits of this study, the following 
conclusions seem tenable: 


1. The test scores of psychotics primarily re- 
flect behavioral inaccessibility rather than 
intrinsic deficit in the intellectual processes 
designated to be measured. Organic as well as 
schizophrenic disorganization of thought pro- 
cess is largely due to behavioral disturbance. 

2. Deficits shown on Wechsler-Bellevue 
Vocabulary, Digits Reversed, Recall I, and Re- 
call II reflect behavioral disturbance and not 
specifically brain damage. Application of this 
suggests that when used without qualification, 
many “deterioration” tests may measure behav- 
ioral rather than organic involvement. 

3. Information, Block Designs, and Thorn- 
dike-Binet Vocabulary reflect thought processes 
that are impaired in direct proportion to behav- 
ioral interference but that are more severely 
impaired, at all levels of accessibility, in instan- 
ces of actual brain damage. 

4. Organics respond to the aids of the Cube 
test because these aids assist in shift of attitude, 
allowing the organics to learn to complete the 
task. Schizophrenics do not respond as well to 
these aids because of greater behavioral dis- 
turbance in this area. 


Received January 2, 1953. 
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Use of The Performance Scale of the Wechsler 
Intelligence Scale for Children with 
the Deaf Child 


E. Ellis Graham and Esther Shapiro 


University of Denver 


Most testing services are not prepared to test 
the deaf because of the scarcity of equipment, 
rarity of occasion, and expense involved. ‘The 
purpose of this study was to investigate the 
possibility of using the Performance Scale of 
the Wechsler Intelligence Scale For Children 
(WISC) to obtain a valid measure of intelli- 
gence in deaf children. For this purpose, 20 
deaf children were compared with two groups 
of hearing children, 20 in each group. 


Much of the emphasis in the education of 
the deaf has been in preparing them vocation- 
ally so that they may be self-supporting. Con- 
comitant goals are related to the achievement 
of more adequate adjustment: to help them en- 
joy a feeling of usefulness, to find group 
acceptance, to experience success as individuals. 
Although it is still controversial whether the 
auditorily handicapped are educationally re- 
tarded [4, 5, 6], the fact that the deaf child 
will eventually have to fit into the hearing 
child’s world makes it imperative that we assess 
his abilities by the same standards that are used 
for the group with which he will compete. 
Since in most instances the deaf must compete 
with the hearing, it seems reasonable that tests 
for both groups be the same, modified only 
when necessary to exclude items dependent 
upon hearing. 


The WISC, introduced in 1949, includes a 
Performance Scale which seems to lend itself 
to the modifications necessary for this type of 
investigation. It requires a minimum of verbali- 
zation, making it useful for nonhearing child- 
ren who have not had the benefit of training in 
lip reading and it is becoming increasingly 
more acceptable in schools and clinics for use 
with the normal-hearing child ; hence it is econ- 


omical in that it is part of the standard equip- 
ment. Its measurement of various cognitive 
areas of intelligence for the normal-hearing 
child can provide a comparison with the deaf 
in whom it may be presumed to measure the 
same abilities. For these reasons the authors 
were interested in investigating the possibility 
of using this test with deaf children. 


Procedure 


In order to test the usefulness of the Per- 
formance Scale of the WISC with deaf child- 
ren, three groups were set up. The members of 
Groups II and III, children with normal hear- 
ing, were individually matched according to 
certain pre-established criteria with the mem- 
bers of Group I, children with marked hearing 
disability. 

Criteria for matching included hearing, 
physical health, sex, color and nativity, age, and 
intelligence. Normal hearing was defined simp- 
ly as the absence of a known auditory defect; 
deafness was defined as a hearing loss of 60 db 
or greater, in both ears, sustained prior to the 
time of significant language developement. 
Good health of all children was established by 
health records, regularity of school attendance, 
and observation for apparent handicaps. The 9 
girls and 11 boys were American-born white 
children, whose ages ranged between six years 
three months and twelve years two months. 
Subjects were matched according to age within 
three-month periods. 

The Goodenough Draw-A-Man Test (D 
AM) was used as the basis for matching indi- 
viduals with respect to IQ. This test was se- 
lected primarily because of its simplicity, both 
in content and in administration, its quick 
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scorability, and because it does not make use of 
material included in the WISC. For the deaf 
group, the teacher or examiner requested that 
the child draw a picture of a man, the best 
picture that he could. As some of the younger 
deaf children did not understand these direc- 
tions, the word MAN was printed on the 
blackboard in an enclosed frame, thus indicat- 
ing to the child that he was to draw a picture. 
Standard directions [1] were given to the nor- 
mal-hearing groups. The tests were scored and 
checked by two competent testers. In the case 
of disagreement, the papers were discarded. 
The IQ range was from 74 to 122 for the total 
number of subjects. Matching on the DAM 
was done within plus or minus five points, the 
probable error, as determined by Goodenough 
for her test [1]. 

The WISC Performance Scale was adminis- 
tered individually to the members of Groups I 
and II through pantomime instructions. Each 
child in the nonhearing group was introduced 
to the examiner by the teacher and told that he 
was going to spend some time with the examin- 
er and play games. The hearing children were 
similarly introduced and told that the examiner 
wished to talk with them and play some games. 
The examiner instructed them that part of the 
game was that they must not talk and that if 
they watched closely, they would be able to 
understand what they should do. It was the 
examiner’s impression that the children consid- 


ered it a privilege to be called for testing and. 


that rapport in all cases was good. 

No difficulty was encountered in the admin- 
istration of the Block Design, Object Assem- 
bly, or Coding tests since these appeared 
rather evident once the material was presented 
to the subject. The Picture Completion test 
seemed to present the most difficulty. After 
making several gestures to indicate that a part 
of the picture was missing, the examiner point- 
ed out the missing parts in the first two pic- 
tures; this procedure was repeated until it was 
felt that the subject had grasped what he was 
to do. The initial four sets of cards in Picture 
Arrangement (designed for subjects under 
eight years of age) and the demonstration set 
were presented to Groups I and II. The dem- 
onstration cards were repeated with appropri- 
ate guestures until the subjects showed that 
they understood. Scoring for the Maze test was 
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modified for Groups I and II, since the exam- 
iner could find no way of preventing the child- 
ren from lifting their pencils from the paper. 
Accordingly, this misdemeanor was not penal- 
ized. 

The subjects in Group III were introduced 
to the examiner either by the examiner or the 
teacher, and were given the WISC in accord- 
ance with the standardized instructions. The 
sixty WISC’s were scored by the examiner in 
strict compliance with the scoring techniques 
[7], except for the modifications mentioned. 


Table 1 


Mean Scaled Scores 








Group Group Group 


I II Ill 


Test 





*Total WISC (Performance) 96.1 95.5 101.15 
Picture Completion 9.5 9.35 9.3 
Picture Arrangement 8.8 9.5 11.6 
Object Assembly 10.75 9.9 9.7 
Block Design 9.85 9.95 9.45 
Coding 8.7 8.5 10.75 
Mazes 8.9 8.85 10.2 





* Total here reported as IQ rather than scaled score 


Results and Discussion 


Inspection of Table 1 shows that no consis- 
tent difference occurs in the mean scores of 
the various subtests in favor of any one group. 
When Group II is compared with Group III, 
statistically significant differences in favor of 
Group III are found for total Performance 
Scale and-three of its subtests: Picture Ar- 
rangement, Coding, and Mazes. Between 
Groups I and III the total Performance Scale 











Table 2 

Significance of Differences between Groups (1) 
Test Groups Groups Groups 
Iand II I and IT and 

Ill Ill 

t t t 
Total WISC 

(Performance) .22 1.7 2.0* 

Picture Completion 15 .22 05 
Picture Arrangement 91 2.8%* 2.4* 
Object Assembly 1.1 1.3 46 
Block Design 14 A6 66 
Coding 31 2.7* .7° 

Mazes 08 2.0* 1.4 





* Significant at 5% level. 
** Significant at 1% level. 








is significantly higher for Group III, as are the 
scores for Picture Arrangement, Coding, and 
Mazes. Group I is significantly higher in per- 
formance on Object Assembly than is Group 
Ill. 


Table 2 indicates that the differences be- 
tween the performances of Groups I and II are 
not statistically significant. It will be noted 
that pantomime instructions were used in both 
these groups in an attempt to standardize the 
method of administration. However, the nor- 
mal-hearing child may be handicapped in that 
he is not accustomed to expressing himself in 
pantomime or to interpreting pantomime direc- 
tions given by others. This method, therefore, 
creates an artificial situation for him. For the 
deaf child, on the other hand, pantomime is a 
more natural means of expression ; he has learn- 
ed through the years to make himself under- 
stood by gestures and to understand others by 
watching for cues in facial and bodily express- 
ions [2}. Group III was included to control 
the artifact which the pantomime instructions 
presented for the hearing child, and because the 
WISC was standardized with oral directions. 
Knowing that the three groups were equated 
in intelligence according to the Goodenough 
DAM, we cannot assume that Group III was 
brighter than either of the other groups. Conse- 
quently, it would seem that the difference in 
performance resulted from the method of 
administration. It is possible that the time fac- 
tor, which operated in five of the six subtests, 
may have been influential in accounting for the 
differences between the groups receiving pan- 
tomime and verbal directions. Hiskey [3] be- 
lieves it is unfair to include speed tests in a 
scale for deaf children as the concept of speed 
is difficult for the young deaf child to grasp. 
In general, this was found to be true, although 
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in several instances the subjects seemed to 
understand. 

Since pantomime seems inseperable from 
deafness, its effect must be considered in any 
test to be used for the deaf. Consequently, al- 
though the Performance Scale of the WISC as 
discussed in this study cannot be used validly 
to obtain a measure of intelligence for deaf 
children, it seems feasible that a correction fac- 
tor which will nullify the effects of the panto- 
mime instructions could be obtained. If such a 
factor can be established, then the test should 
be doubly valuable in assessing the deaf child’s 
intellectual functioning. As it is, the test can 
be administered via pantomime as a crude meas- 
ure, 
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Books 


Barker, Roger G., Wright, Beatrice A., Meyerson, 
Lee, & Gonick, Mollie R. Adjustment to physical 
handicap and illness: a survey of the social psy- 
chology of physique and disability. (Rev. Ed.) 
Soc. Sci. Res. Coun. Bull. No. 55, Rev. 1954. Pp. 
xvi + 440. (paper) $2.00. 


The effect of physical handicaps, cosmetic and 
functional, on attitudes and personality is well 
known, although generally little understood. The 
foreword to the first edition of this important sur- 
vey quotes an illuminating passage from Sir Francis 
Bacon on the topic written over 300 years ago. The 
soma-psyche relations have recently had much elab- 
oration in the various fields of psychosomatic medi- 
cine. This publication stresses the somatopsycholo- 
gical relations of physique and behavior with spe- 
cial reference to theory, research, and practice. 
Well-organized treatment is evident in the carefully 
outlined table of contents, extensive topical bibli- 
ography, careful author index, and detailed subject 
index. The volume is much too good to receive only 
casual comment. It should be read with studious 
care. The principle of adjustment to handicap rath- 
er than adjustment of the handicapped is clearly 
revealed as a significant reorientation which re- 
ceives increasingly wide acceptance —E. A. D. 


Goldhamer, Herbert, & Marshall, Andrew W. 
Psychosis and civilization: two studies in the fre- 
quency of mental disease. Glencoe, Ill.: The Free 
Press, 1953. Pp. 126. $4.00. 


This research monograph offers the best answer 
which the reviewer has yet seen to the often-asked 
question, “Is mental disorder on the increase?” The 
first of the two studies reported is based on a critical 
historical and statistical analysis of data covering 
a hundred-year period. It answers the question con- 
vincingly, “No.” The second study, less cheerful in 
its conclusion, estimates that a person today has 1 





Note.—The reviews were prepared by the Editor 
and the Associate Editors, who may be identified by 
their initials. 
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chance in 20 of being affected by serious mental 
disorder by the age of 45, and 1 chance in 10 by 
the age of 65. The entire monograph deserves the 
careful attention of psychologists.—L. F. S. 


Karpf, Fay B. The psychology and psychotherapy 
of Otto Rank. New York: Philosophical Library, 
1953. Pp. xii + 129. $3.00. 


This is a brief summary and sympathetic critique 
of Rank’s theoretical contributions to psychoanalysis 
and psychology. The treatment is integrative and 
interpretative rather than narrowly factual, and the 
book makes pleasant and thought-provoking reading. 


—W. A. H. 


Kessler, Henry H. Rehabilitation of the physically 
handicapped. (Rev. Ed.) New York: Columbia 


Univer. Press, 1953. Pp. xv + 275. $4.00. 


The five years that have elapsed since the pub- 
lication of the first edition of this book have shown 
us the continued need for the total utilization of 
manpower. There has been a steady growth in the 
recognition of the value and importance of rehabili- 
tation. In the second edition Dr. Kessler has taken 
care to bring the illustrative material and tables up 
to date. There has been 
some of the chapters; 


a complete rewriting of 
for example, the one on voca 
tional training, and the one on the blind and the 
deaf. The book should continue to occupy its im- 
portant position as a source book for those working 
with the mentally and physically handicapped. 
There is an excellent index and a list of major 
centers and agencies for the handicapped.—B. M. L. 


Lindquist, E. F. Design and analysis of experiments 
in psychology and education. Boston: Houghton 
Mifflin, 1953, Pp. xix + 393. $6.50. 


Lindquist’s most recent textbook on design is es- 
sentially a modernized, more sophisticated version 
of his widely-used Statistical Analysis in Educa- 
tional Research (1940). Six main types of design 
are considered in detail, together with their variants 
and mixtures: simple-randomized, treatments by 
levels, treatments by subjects, random replications, 
factorial, and groups-within-treatments. The au- 
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thor’s plan, to begin the exposition of each design 
with basic principles and mathematical derivations 
instead of concrete illustrations, makes for hard 
reading but prevents the student from looking for 
mere recipes. Ample exercises follow each chapter. 
The book is best used as a text in conjunction with 
competent class instruction. It can also serve as a 
stimulating reference for psychologists with a good 
command of basic statistics—L. F. S. 


Mowrer, O. Hobart. (Ed.) Psychotherapy: theory 
and research. New York: Ronald Press, 1953. Pp. 
xviii + 700. $10.00. 


Twenty-two psychologists collaborated in the 
preparation of this impressive volume which com- 
bines eight chapters of e says on methods and the- 
ory, 201 pages, with eleven chapters, 455 pages, on 
research techniques and findings. The chapters on 
theory vary greatly in their nature, but one cannot 
imply that they are uneven in quality; each is a 
good and typical example of its author’s work. To 
refer to only a few: May gracefully relates therapy 
to its philosophical background; Rogers illustrates 
some of his convictions with excerpts from inter- 
views; Mowrer presents a theory of neurosis and 
therapy synoptically. The most notable character- 
istic of the volume, in contrast with most other 
books on psychotherapy, is that it devotes more 
than two-thirds of its length to research studies. All 
of the materials are meaty. Some are summaries or 
extensions of research programs already reported, 
as in Seeman and Raskin’s chapter on research in 
client-centered therapy, and in Dollard’s and Mow- 
rer’s separate sections on measuring tension in writ- 
ten documents. There are methodological contribu- 
tions by Mowrer, Cronbach, McQuitty, and others. 
Research results not reported elsewhere include stu- 
dies of verbal behavior and of tension changes dur- 
ing psychotherapy, carried out by Mowrer and his 
students. The volume as a whole is hard to cate- 
gorize. It is not exactly a text, a treatise, or a re- 
search report, but is something of all three. It is 
decidedly worth reading, by psychologists and by 
their advanced students.—L. F. S. 


Overholser, Winfred. The psychiatrist and the law. 
New York: Harcourt, Brace, 1953. Pp. x + 147. 
$3.50. 


In their roles both as citizens and as professionals, 
psychologists will find this little book stimulating 
and informative. Winner of the Isaac Ray Award 
for the most worthy “contribution to the improve- 
ment of the relations of Law and Psychiatry,” it 
presents a provocative social psychological analysis 
ot the law as an institution, trenchantly examines 
the legal issues involved in the commitment, institu- 
tional maintenance, and release of patients in psy- 
chiatric hospitals, and discusses with great insight 
the functions and problems of the student of behav- 
ior as an expert witness. Dr. Overholser writes out 
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of rich personal experience, with a genuine scholar’s 
large familiarity with legal precedents and the rele- 
vant literature in the history of both psychiatry and 
law, and from a broad and humane point of view. 
His contribution to interdisciplinary understanding 
is considerable, and his illustration of how one pro- 
fession deeply concerned with human conduct can 
usefully and constructively criticize another pro- 
vides a model to which the other behavioral sciences 
might well pay heed. It is regrettable that his keen 
thinking was not directed toward those legal matters 
bearing on interprofessional relationships, and one 
wonders if he does not protest too much in his re- 
peated insistence that all legally relevant mental 
states constitute medical questions.—E. J. S. 


Podolsky, Edward. (Ed.) Encyclopedia of aberra- 
tions. New York: Philosophical Library, 1953. 
Pp. ix + 550. $10.00. 


This volume is the result of the efforts of fifty- 
one physicians most of whom are psychiatrists, 
seven psychologists, and one chemist. The articles 
(or original papers, as Alexandra Adler calls them 
in a foreword) vary in length from a single line to 
many pages. Twenty-six pages, for example, are de- 
voted to the psychopathic personality. The topics 
are mostly well-known symptoms and syndromes. 
There are also definitions of less familiar terms as 
well as discussions of a few basic concepts. A sam- 
ple of topics includes aboiement, anti-Semitic atti- 
tudes, anxiety states, disorientation of body image, 
coarctation, folie 4 deux, gelasmus, nonadaptive 
group behavior, nuns’ melancholy, orality, behavior 
during puberty, and sophomania. The organization 
within the topics varies greatly. Some topics include 
long cases, a few contain tables, diagrams, and 
Rorschach summaries. Bibliographies and references 
to other publications are extremely rare. Many ar- 
ticles deal with theoretical explanations of the phe- 
nomena. The writing style is quite readable; in fact, 
almost popular in nature. The reviewer misses an 
index or lengthy table of contents and feels the 
absence of it will reduce efficiency in the use of the 
book. There also seem to be few cross-references. 
Some of the topics represent an excellent review of 
the phenomena.—F. McK. 


Reid, Joseph H., & Hagan, Helen R. Residential 
treatment of emotionally disturbed children. New 
York: Child Welfare League of America, Inc., 
1952. Pp. ix + 313. $3.50. 


In the more severe behavior disturbances of chil- 
dren, and those where family life is not conducive 
to recovery at home, therapeutic programs of extra- 
familial procedures have been often used. This 
study reports a descriptive survey of twelve resi- 
dential treatment centers, in order to provide guid- 
ance in establishing similar programs elsewhere. 
Five of these centers represent social agency pro- 
grams, and seven are essentially medical (psychi- 
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atric), representing the major developments in this 
field in the United States. Three are supported by 
public funds and nine by private and community 
funds, one primarily by patient fees. The study de- 
liberately avoids evaluation, concentrating instead 
on such issues as organization, plant and grounds, 
intake policies and procedures, popu!ation, staff, 
treatment program, costs, personnel training. The 
report is factually informing as to resources and 
practices. Professional readers will sense numerous 
implications and will no doubt derive evaluations 
of their own. Psychologists will be specially interest- 
ed in the opportunities for service afforded and the 
conditions of professional and interprofessional col- 
laboration.—E, A. D. 


Sullivan, Harry Stack. The interpersonal theory of 
psychiatry. New York: Norton, 1953. Pp. xviii + 
393. $5.00. 


Harry Stack Sullivan’s approach to psychiatry, 
as expressed in The Interpersonal Theory of Psy- 
chiatry, will probably be more acceptable to psy- 
chologists than that of any other well-known psy- 
chiatrist. He arrived at his destination via clinical 
research in schizophrenia and analytic therapy in 
the psychoneuroses; the vehicles were psychoanaly- 
sis, Adolph Meyer’s psychobiology, field theory, 
and social psychology. The result is an eclecticism 
that is dynamic and significant. Sullivan rejects the 
concept of psychiatry as merely the study and treat- 
ment of abnormal behavior; much more important, 
as far as he is concerned, is the study of interper- 
sonal relationships. This work is an edited version 
of Sullivan’s lectures and notebooks from 1946 to 
1949, the year of his death. Since his lectures were 
more sparkling than his writing, this volume, fre- 
quently in colloquial vein, makes interesting and 
relatively easy reading.—M. K. 


Whiting, John W. M., & Child, Irvin L. Child 
training and personality: a cross-cultural study. 
New Haven: Yale Univer. Press, 1953. Pp. vii 
+- 353. $5.00. 


An important research report on the interrelations 
vetween personality and culture as seen in data 
about 75 societies, obtained mainly from the Human 
Relations Area Files of the Institute of Human Re- 
lations. The orientation is toward the testing of 
general hypotheses, drawn from psychoanalysis and 
general behavior theory, rather than toward the 
understanding of any one society. A correlational 
method is used, each culture being considered as a 
unit. The results, which should be examined in de- 
tail, give little support to some hypotheses and much 
to others. In general, they confirm the need to di- 
vide broad psychoanalytic formulations into more 
detailed hypotheses restated in terms of general 
behavior theory. No one should teach a course or 
write a book on personality without considering the 
evidence preesnted here —L. F. S. 


Tests 
Bennett, George K., & Gelink, Marjorie. Short Em- 


ployment Tests, 1953 Manual. New York: Psy- 
chological Corp., 1953. Pp. 10. 35¢. 


The battery of three five-minute tests for clerical 
applicants—verbal, numerical, and clerical aptitude 
—was issued in 1951 with a preliminary manual (see 
J. consult. Psychol., 1952, 16, 159). The new man- 
ual contains evidence of the validities of the tests 
in terms of various relevant criteria, obtained from 
six different businesses. There are also tables of 
reliabilities, intercorrelations, relations to other tests, 
and norms.—L. F. §. 


Bruce, Martin M. Sales Comprehension Test, Form 
M. Adults. 1 form. Untimed, (20) min. Test 
booklet (20¢), with manual, pp. 8; specimen set 


($1.00). 


Business Judgement Test. Adults. 1 form. Un- 
timed, (15) min. Test booklet (15¢), with man- 
ual, pp. 4; specimen set (75¢). 


Sales Motivation Inventory. Adults. 1 form. 
Untimed, (30) min. Test booklet (15¢), with 
manual, pp. 4; specimen set (75¢). New York 9 
(624 E. 20 St.): Author, 1953. 


These three business tests are of special interest 
because of the author’s explicit plan to report data 
according to the recommendations of the APA Com- 
mittee on Test Standards. As a result, the manuals 
are more informative than are many such docu- 
ments, and candidly show the limitations as well as 
the values of the tests. The Sales Comprehension 
Test is the best-developed of the three, being based 
on item analyses and other studies carried out over 
a period of several years. It discriminates salesmen 
and nonsalesmen successfully, and has some rela- 
tionship to success in selling. The other two tests 
are not as fully developed, but their manuals show 
some preliminary evidence of usefulness, and are 
free from undue claims.—L. F. S. 


Wood, Hugh B. Behavior Preference Record. 3 \ev- 
els, Gr. 4-6, 7-9, 10-12. 2 forms at each level. 
Untimed, (30-45) min. IBM, Scoreze, or hand 
scoring. Test booklet (8¢); answer sheet (4¢) ; 
Scoreze (7¢) ; with manual, pp. 16; specimen set 
(35¢). Los Angeles: California Test Bureau, 
1953. 


This questionnaire presents 15 to 20 described 
interpupil situations in school settings, each fol- 
lowed with multiple-choice alternatives for re- 
sponses to “what would you do?” and “because.” It 
is scored for five variables which are called co- 
operation, friendliness, integrity, leadership, and 
responsibility, and for a critical thinking score pre- 
sented as an index of the degree of rationalization 
indicated in the “because” choices. Statistical data 





402 


are given fully, including (for the Grade 10 to 12 
forms), trait reliabilities ranging from .72 to .90, 
correlations with teacher’s ratings ranging from .46 
to .78, and trait intercorrelations from —.03 to + 
-34. Norms are based on “some seventeen hundred” 
cases, which are unspecified with respect to levels 
and forms. While the blank may evoke some useful 
thinking about the social characteristics of pupils, 
it suffers from numerous faults. The prestige values 
of the responses were not controlled. As in all such 
short questionnaires, radically different interpreta- 
tions from “average” to “very high” may be drawn 
from scores which differ by as little as 3 points 
when the standard error of measurement is as great 
as 2.8 points.—L. F. §. 


Books Received 


Berkman, Tessie D. Practice of social workers in 
psychiatric hospitals and clinics. New York (1860 
Broadway): Amer. Assoc. of Psychiatric Social 
Workers, 1953. Pp. ix + 158. (paper) $2.00. 


Buros, Oscar Krisen. (Ed.) The fourth mental mea- 
surements yearbook. Highland Park, N. J. (220 
Montgomery St.) : Gryphon Press, 1953. Pp. xxiv 
+ 1163. $18.00. 


Hammond, Kenneth R., & Allen, Jeremiah M., Jr. 
Writing clinical reports. New York: Prentice- 
Hall, 1953. Pp. xii + 235. $5.35. 


Heiman, Marcel. (Ed.) Psychoanalysis and social 
work. New York: International Universities 
Press, 1953. Pp. xiv + 346. $5.00. 


Kubie, Susan H., & Landau, Gertrude. Group work 
with the aged. New York: International Univer- 
sities Press, 1953. Pp. 214. $3.50. 
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Lacey, Oliver L. Statistical methods in experimenta- 
tion. New York: Macmillan, 1953. Pp. xi + 249. 
$4.50. 


Lindgren, Henry Clay. The psychology of personal 
and social adjustment. New York: American 
Book Co., 1953. Pp. ix + 481. $4.50. 


Moreno, J. L. Who shall survive? Beacon, N. Y.: 
Beacon House, 1953. Pp. cxiv + 763. $10.00. 


Naumburg, Margaret. Psychoneurotic art. New 
York: Grune & Stratton, 1953. Pp. x + 148. 
$6.75. 


Peters, R. S. (Ed.) Brett's history of psychology. 
New York: Macmillan, 1953. Pp. 742. $7.50. 


Riese, Walther. The conception of disease. New 
York: Philosophical Library, 1953. Pp iv + 120. 
$3.75. 


Roheim, Geza. The gates of the dream. New York: 
International Universities Press, 1952. Pp. x + 
554. $10.00. 


Sabine, Paul E. Atoms, men and God. New York: 
Philosophical Library, 1953. Pp. x + 256. $3.75. 


Townsend, John C. Introduction to experimental 
method. New York: McGraw-Hill, 1953. Pp. ix 
+ 220. $4.00. 


Westwood, Gordon. Society and the homosexual. 
New York: Dutton, 1953. Pp. 191. $3.00. 


Woolf, Maurice D., & Woolf, Jeanne A. The stu- 
dent personnel program. New York: McGraw- 
Hill, 1953. Pp. ix + 416. $5.00. 








Here for the first time is a detailed account 
of an actual therapeutic case 


IN PSYCHOTHERAPY 


John Dollard, Frank Auld, Jr., & Alice M. White 


This book shows the student what ac- 
‘ually happens in psychotherapy, us- 
ing, as illustrative material, a detailed 
account of the handling of a thera- 
peutic case by a student-therapist 
with the supervisor’s running com- 
mentary on the student’s methods. Fol- 
loving the presentation of the case, 


there is a discussion of what the steps 
in this case were; then a discussion of 
sex-fear conflicts in marriage; and 
finally, a discussion of the psychologi- 
cal tests given to this patient and the 
ways in which their results might be 


used. 
222 pp. $3.50 


The Macmillan Company 


60 FIFTH AVENUE, NEW YORK 11, N.Y. 

















New Book Ansouncements 





PERSONNEL MANAGEMUNT. New 5th Edition 


By Watrer Dai Scorr, Northwestern University; Roserr C. Ciormies, Raotgers 
University; and Wo.1tam R. Spreice:, University of Texas. Ready in January. 


This comprehensive new revision elim utdated materia! anc’ brings the text com- 
pletely up to date. A new chapter on ‘P: nel Management as a Coordinating Function” 
has been added to complete this outstanding outline of principle, practices, and instru- 
ments io the important relatiouships between management and workers. 





PSYCHOANALYTIC THEORIES OF PERSONALITY 


By Geraip S, 3L.um, University higan. McGraw-Hill Serics im Psychology. 
219 pages, $3.75 


The first integrated treatment of vario: choanalytic theories (propounded by Freud 
and other leading theorists) en person: [t constitaxes an indispensable guide to the 
graduate student in clinical psycholo; | to the psychiatrist. The integration takes 
place by fitting the contribution of cach theorist into a gemetic sequence from before birth 
up to adulthood. The author evaluates th ries from a@ scientific research standpoint, in- 
cluding brief resumes of existing expe: mcotal data, suggestive evidence from related 
fields (cultural anthropology and learning theory), consideration of logical inconsistencies 
and semantic confusion:, and compariso: verlapping views. 





THE PROCESS OF PSYCHOTHERAPY 


By Haraincron V. Incuam, M. D., | Liversity of California at Los Angeles; and 
Lzonors R. Love, Los Angeles Psychia Services, California. In press 


An exceptionally well-organized, clear 2:4 sound imtroduction to psychetherapy for the 
professional student, this book describes ‘he ways in which a psychotherapist works, Em- 
phasis is ce.xered on the activities invo'ved and there is no attempt? to introduce the dy- 
namics of personality except where immediaicly necessary for description of what happens 
to a person while being treated. 





THE EDUCATION OF EXCEPTIONAL CHILDREN 
New 2nd Edition 


By Arcu O. Heck, Ohio State University. McGraw-Hill Series in Education. 513 
. pages, $6.00 


Here is a thorough revision of this ov tstandiog text, rewritten, brought statistically to date, 
and inc! all progress iu theory, practice, programs, and equipment. It covers the edu- 
cation of ly, physically, and ment«!'\ exceptional children—gifred as well as handi- 
capped, and deals erred with such p ns as discovery, prevention, and special needs 
for educating such children. 





Send for copies on approval 


McG6.tA W- HILL BOOK GO., INC. 


330 West 42nd Sirect, New York 25, N.Y. 














